Poisson Hypothesis for information networks 
(A study in non-linear Markov processes) 

Alexander Rybko 
Institute for the Information Transmission Problems, 
Russian Academy of Sciences, Moscow, Russia 
rybko@iitp.ru 

Senya Shlosman 
Centre de Physique Theorique, CNRS, 
Luminy, 13288 Marseille, France 
shlosman@cpt.univ-mrs.fr 

February 7, 2008 

Abstract 

In this paper we prove the Poisson Hypothesis for the limiting 
behavior of the large queueing systems in some simple cases. We 
show in particular that the corresponding dynamical systems, defined 
by the non-linear Markov processes, have a line of fixed points which 
are global attr actors. To do this we derive the corresponding non- 
linear integral equation and we explore its self-averaging properties. 
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1 Introduction 

The Poisson Hypothesis deals with large queueing systems. For general sys- 
tems one can not compute exactly the quantities of interest, so various ap- 
proximations are used in practice. The Poisson Hypothesis was formulated 
first by L. Kleinrock in jKj. It is the statement that certain approximation 
becomes exact in the appropriate limit. It concerns the following situation. 
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Suppose we have a large network of servers, through which customers are 
travelling, being served at different nodes of the network. If the node is busy, 
the customers wait in the queue. Customers are entering into the systems via 
some nods, and the external flows of customers from the outside are Poisso- 
nian. The service time at each node is random, with some fixed distribution, 
depending on the node. We are interested in the stationary distribution 7T/v 
at a given node A/": what is the distribution of the queue at it, what is the 
average waiting time, etc. If the service time distributions are different from 
the Poisson distribution, then the distribution tt^ in general can not be com- 
puted. The recipe of the Poisson Hypothesis for approximate computation 
of Titf is the following: 

• consider the total flow T of customers to the node Af. (In general, T 
is not Poissonian, of course.) Replace T with a constant rate Poisson 
flow V, the rate being equal to the average rate of T. Compute the 
stationary distribution ttj^ at A/", corresponding to the inflow V. (This 
is an easy computation.) The claim is that ftj\f « n^-. 

The Poisson Hypothesis is supposed to give a good estimate if the internal 
flow to every node A^ is a sum of flows from many other nodes, and each of 
these flows constitute only a small fraction of the total flow to M . 

Clearly, the Poisson Hypothesis can not be literally true. It can hopefully 
hold only after some kind of "thermodynamic" limit is taken. 

In the present paper we prove the Poisson Hypothesis for the information 
networks in some simple cases. Namely, we will consider the following closed 
queueing network. Let there be M servers and N customers to be served. 
The distribution of the service time is given by some fixed random variable n. 
Upon being served, the customer chooses one of M servers with probability 

and goes for the service there. Then in the limit M, N — > 00, with M — > p, 
the Poisson Hypothesis holds, under certain general restrictions on n. 

An important step in this problem was made in the paper |KRlj . Namely, 
it was shown there that the above mentioned flow T converges in our limit to 
a Poisson random process with some rate function A it). If one would be able 
to show additionally that A (t) — > c — const as t — > 00, that will be sufficient 
to establish the Hypothesis. However, the technique of j KRlj was not enough 
to prove the relaxation property A (t) — > c. It was proven there that the sit- 
uation at a given single server is described by the so-called non-linear Markov 
process fi t with Poissonian input with rate A (t) , and the (non-Poissonian) 
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output with the same rate. Another way of saying this is that corresponding 
non-linear Markov process defines some complicated dynamical system, and 
the problem was to study its invariant measures. Namely, this system has 
one parameter family of fixed points, and the question is about whether it 
has other invariant measures. 

In the present paper we complete the picture, showing that the above 
relaxation A (t) — > c indeed takes place, and so \i t — > fJ, c , where \i c is the 
stationary distribution of the stationary Markov process with the Poisson 
input, corresponding to constant rate A (t) = c. In the language of dynamical 
systems we show that there are no other invariant measures except these 
defined by the fixed points. 

The central discovery of the present paper, which seems to be the key to 
the solution of the problem, is that, roughly speaking, the function A (t) has 
to satisfy the following non-linear equation: 

A (f) = [A (•) * q KU (•)] (t) . (1) 

Here * stays for convolution: for two functions a(t) ,b (t) it is defined as 

[a (•) * b (•)] (t) = J a(t — x)b (x) dx, 

while q\(.),t (•) is a one-parameter family of probability densities with t real, 
which depends also in an implicit way on the unknown function A (•). We 
call the self-averaging property. The present paper consists therefore 
of two parts: we prove that indeed the self-averaging relation holds, and we 
prove then that it implies relaxation. 

It is amazing that the relation (P) depends crucially on some purely com- 
binatorial statement concerning certain problem of the placement of the rods 
on the line M 1 , see Section 6. 

To fix the terminology, we remind the reader here what we mean by the 
non-linear Markov process (see |Mlj . |M2j ) . We do this for the simplest 
case of discrete time Markov chains, taking values in a finite set S, \S\ = k. 
In such the set of states of this Markov chain is a simplex A& of all 

probability measures on S, A^ = {ji = (pi, ...,pk) '■ Pi > 0,pi + ... + pu = 1} , 
while the Markov evolution defines a map P : — > A^. In the case of usual 
Markov chain P is affine, and this is why we will call it linear chain. In 
this case the matrix of transition probabilities coincides with P. If P is non- 
linear, we will call such a process a non-linear Markov chain. It is defined 
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by a family of transition probability matrices P^, fi G A k , so that matrix 
element P^ {i,j) is a probability of going from i to j in one step, starting in 
the state fi. The (non-linear) map P is then defined by P (fi) = fiP^. 

The ergodic properties of the linear Markov chains are settled by the 
Perron- Frobenius theorem. In particular, if the linear map P is such that the 
image P (A fc ) belongs to the interior Int (A fc ) of A fc , then there is precisely 
one point fi G Int (A fc ) , such that P (fi) = fi, and for every v G A k we have 
P n (v) — > /i as n — > oo. 

In case P is non-linear, we are dealing with more or less arbitrary dynam- 
ical system, and the question about stationary states of the chain or about 
measures on A k invariant under P can not be settled in general. 

Therefore it is natural to ask about the specific features of our dynamical 
system, which permit us to find all its invariant measures. We explain this 
in the following subsection. 

Dynamical systems aspect. Here we will use the notation of the paper, 
though in fact the situation of the paper is more complicated; in particular 
the underlying space is not a manifold, but a space of all measures over some 
non-compact set. 

Let M be a manifold, supplied with the following structures: 

• for every point fi G M and every A > a tangent vector X (fi, A) at fi 
is defined, 

• a function b : M — > M + is fixed. 



We want to study the dynamical system 

j t fi(t)=X(fi(t),b(fi(t))). (2) 

Its flow conserves another given function, N : M — > M + , and we want to 
prove that our dynamical system has one-parameter family of fixed points - 
each corresponding to one value of N - and no other invariant measures. 

We have the following extra properties of our dynamical system: 

Let \(t) > 0; consider the differential equation 

j t fi(t)=X(fi(t),\(t)),t>0, (3) 
with fi (0) = v. We denote the solution to it by fi v ,\{-) if) ■ We know that 
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• for every c > and every initial data u, the solution H v ,\{-) if) to (j2J) 
converges to some stationary point v c e M, 

A i i/,A(-) (t) — » t'o provided A (i) — > c as £ — > oo, (4) 

• for the function iV we have 

jN (^, A( .) (t)) = A it) - b (^ A( .) (t)) . 

In particular, for every trajectory jj, u (t) of (J2J) (where /i v (0) = v) we 
have A" {ji v (t)) — N {v) . Also, A" (z/ c ) is continuous and increasing in 

c; 

• for every z/, A (•) and every t > there exists a probability density 
ft,A,t ( x ) j £ > 0, such that 

& (/i„,A(.) (*)) = (A * ft,A,t) (*) , 

where 



(A * q v ,\,t) (y) = 




ft,A,t (x) X(y — x) dx. 



The family q v> x,t ( x ) satisfies: 

i 

<lu,\,t {%) dx = 1 for all u, A, t, 
and 

inf q uXt (x) > 0. 

i/,X,t 
x6[0,l] 

Then for every initial state z/ 

/2„ (t) -s- i/ c , (5) 
where c satisfies A" (z/ c ) — N (u) . 

Our statement follows from the fact that the self-averaging property, 

/ (t) = (/ * ft) (t) , 
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with q t (•) being a family of probability densities on [0, 1], implies that / (t) — > 
const as t — > oo, so © follows from (J3J) . 

We feel that the relation ((TJ is an important feature of the subject we 
are interested in. Therefore in the present paper we study it and the related 
questions in some generality. 

i) We start with the equation 

/(*) = [f (•)**(■)](*)■ (6) 

Here we suppose that q t (•) is just some one-parameter family of probability 
densities (without functional dependence), so (0) is a special case of (JUJ) . On 
the other hand, we suppose additionally that all the distributions q t (•) are 
supported by some finite interval. We establish relaxation in this case. 

ii) We then do the same for the case of distributions q t (•) with unbounded 
support. 

Hi) Last, we treat the true problem, where in addition to the infinite 
support, an extra parameter \i appears and an extra perturbation is added 
to convolution term in (JHJ) : 

A (t) = (1 - e Xi , (t)) [A (•) * q X;fl!t (■)] (t) + ey, (t) Q x ,, (t) . (7) 

Here the parameter (t) is small: (t) — > as t — > oo, the term (t) 
is uniformly bounded, while the meaning of fi will be explained later. 

As we proceed from i) to Hi), we will have to assume more about the 
class of distributions {q.} , for which the self-averaging implies relaxation. 

We finish this introduction by a brief discussion of the previous work on 
the subject, and their methods. 

As we said before, part of the proof of the Poissonian Hypothesis - the 
so called Weak Poissonian Hypothesis - was obtained in |KRlj . By prov- 
ing that the Markov semigroups describing the Markov processes for finite 
M, N, converge, after factorization by the symmetry group of the model, to 
the semigroup, describing the non-linear Markov process, the authors have 
proven that the limit flows to each node are independent Poisson flows with 
the same rate function A (t) . This statement is fairly general, and can be gen- 
eralized to other models with the same kind of the symmetry - the so-called 
mean-field models. The general theory - see, for example, fL - implies then, 
that all the limit points of the stationary measures of the Markov processes 
with finite M, N are invariant measures of the limiting non-linear Markov 
process. The remaining step - the proof that the limiting dynamical system 
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has no other attractors except the one-parameter family of the fixed points 
- is done in the present paper. Apriori this fact is not at all clear, and one 
can construct natural examples of the systems with many complicated at- 
tractors, which are reflected in the complex behavior of the Markov processes 
with finite M, N. However, the self-averaging property, explained above, rules 
out such a possibility. It seems that the self-averaging property can also be 
generalized to other mean-field models. 

The Poisson Hypothesis was fully established in a pioneer paper [St] for 
a special case when the service time is non-random. This is a much simpler 
case, and the methods of the paper can not be extended to our situation. 
They are sufficient for a simpler case of the Poissonian service times, which 
case was studied in |KR2j . 

The paper [DKV. deals with another mean-field model, describing some 
open queueing network. Though the Poisson Hypothesis does not hold for 
it, the spirit of the main statement there is the same as in the present pa- 
per: the limiting dynamical system has precisely one global attractor, which 
corresponds to the fixed point. 

One of specific feature of the method of the paper [DKV] , as well as related 
paper |DFj . is that the Markov processes have countable sets of values. So 
one can in principle use monotonicity arguments and stochastic domination. 
In our situation the phase space is (one-dimensional) real manifold, and this 
technique does not seem to be applicable. 

The importance of the Poisson Hypothesis as the central problem of the 
theory of large queueing systems was emphasized, among others, by Roland 
Dobrushin [D] and Alexander Borovkov jB]. 

2 Notation 

In this section we will fix the notation for the non-linear Markov process, 
which takes place at a given server in the above described limit. 

Server. It is defined by specifying the distribution of the random serving 
time f], i.e. by the function 

F (t) = Pr {serving time rj > i} . 

We suppose that rj is such that: 

• the density function p (t) of rj is positive on t > and uniformly 
bounded from above; 
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• p (t) satisfies the following strong Lipschitz condition: for some C < oo, 
some positive function u (t) and for alH > 

\p(t + At)-p(t)\<Cp(t)\At\, (8) 

provided t + At > and \At\ <u(t); 

• introducing the random variables 

7] — (rj — t i] > ,t > 0, 
we suppose that for some 5 > 0, M$ < oo 

/ \ 2+5 

E[rj J < M 5 (9) 
for all r; therefore, for the conditional expectations we have 

E(r) ) < C (10) 

uniformly in r > 0; 

• Without loss of generality we can suppose that 

E(77) = l. (11) 
In what follows, the function p (•) will be fixed. 

Configurations. By a configuration of a server at a given time moment t 
we mean the following data: 

• The number n > of customers waiting to be served. The customer 
who is served at t, is included in the total amount n. Therefore by 
definition, the length of the queue is n — 1 for n > 1, and for n = 0. 

• The duration r of the elapsed service time of the customer under the 
service at the moment t. 

Therefore the set of all configurations Q is the set of all pairs (n, r) , 
with an integer n > and a real r > 0, plus the point 0, describing the 
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situation of the server being idle. For a configuration uj = (n, r) e ^ we 
define TV (w) = n. We put JV (0) = 0. 

States. By a state of the system we mean a probability measure \x on fi. 
We denote by M. (Q) the set of all states on Q. 

Observables. There are some natural random variables associated with 
our system. One is the queue length, = (uj) . We denote by iV (//) the 
mean queue length in the state \i : 

N( / j.)=E(N lt ) = (N ll (u)) lt , 

and we introduce the subsets M. q (Q) C M. (Q) , q > by 

M q (Q) = {fiEM(tt):N (fj) = q} . 

Another one is the expected service time 



for uo = 0, 

(n — 1) E (77) + E (rj j for cu = (n, r) , with n > 0. 



S(u) = 
Again, we define 

S( t i) = {S(u)) lt . 

Clearly, 

S(h)<CN(jm). (12) 

Input flow. Suppose that a function A (t) > is given. We suppose that 
the input flow to our server is a Poisson process with rate function A (t) , 
which means in particular that the probabilities Pk (t, s) of the events that k 
new customers arrive during the time interval [t, s] satisfy 

( X(t)At + o(At) for k = 1, 

P k (t, t + At) = I 1 - A(t) At + o(At) for£; = 0, 
[ o(At) for k > 1, 

as At — > 0, while for non-intersecting time segments [ti, si] , [^2, S2] the flows 
are independent. 

Output flow. Suppose the initial state v = \i (— T) , T > 0, as well as the 
rate function A it) , with A (t) =0 for t < — T, of the input flow are given. 
Then the system evolves in time, and its state at the moment t is given by 
the measure 

A* (t) = /Va(-) (t) ■ 
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In particular, the probabilities Qk (t, s) = Qk (t, s; v, A (•) ,p (•)) of the events 
that k customers have finished their service during the time interval [t, s] are 
defined. We suppose that the customer, once served, leaves the system. 

The resulting random point process Q. (•, •) need not, of course, be Pois- 
sonian. However we still can define its rate function b (t) as the one satisfying 



as At — > 0. The rate function b (•) of the output flow is determined once the 
initial state v = // (0) and the rate function A (•) of the input flow are given. 
Therefore the following (non-linear) operator A is well defined: 



We will call the general situation, described by the triple u, X (•) , b (•) = 
A (u, X (•) , — T), as a General Flow Process (GFP). 

The following is known about the operator A, see |KRlj : 

• For every initial state v the equation 



has exactly one solution A (-) = A„ (-) . Then the evolving state (i U) \ u f.) (t) 
is what is called the non-linear Markov process, which we will abbrevi- 
ate as NMP. 

• The non-linear Markov process has the following conservation property: 



(because "the rates of the input flow and the output flow coincide"). 
So one can say that the spaces Ai q (fl) are invariant under non-linear 
Markov evolutions. 

• All the functions X u (•) are bounded: 




b(-)=A(v,X(-),-T). 



A(v,X(-))=A(v,X{-),0) = X(-) 



for all t 



N (/i„, M .) (t)) = N (u) 



X u {t)<C = C{rj) 



(13) 



uniformly in v and t. 
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• For every constant c G [0, 1) there exists the initial state v c , such that 

A(u c ,c) = c. (14) 

(Here we identify the constant c with the function taking just one 
value c everywhere.) Moreover, this measure v c is a stationary state: 
fiv c ,c (t) = v c for all t > 0. The function c N (u c ) is continuous 
increasing, with N (z/ ) = 0, N (u c ) j oo as c — > 1. 

The non-linear Markov process (J* v ,\ v (-) (0 is the main object of the present 
paper. Therefore we will give below another definition of this process, via 
jump rates of transitions during the infinitesimal time, At. So suppose that 
our process is in the state /i G M. (Q) , and assumes the value ui = (n, r) G Q. 
During the time increment At the following two transitions can happen with 
probabilities of order of At : 

• the customer under the service will finish it and will leave the server, 
so the value (n, r) will become (n — 1, q) , with q < At. The probability 
of this event is 

ci At + o (At) , 

where 

/ x r 1 Ir +At p( X ) dx 

d = ci (u) = hm — oo — ; 

At^o At J r p (x) dx 

• a new customer will arrive to the server, so the value (n, r) will become 
(n+ 1, r + At) . The probability of this event is given by 

c 2 At + o (At) , 

where 

c 2 = c 2 {n) = E M (ci (w)) . 

In words, the input rate is the average rate of the output in the state 
fi. 



It is curious to note that while for the general nonlinear continuous time 
Markov processes its rates depend both on the value and on the state of the 
process, in our case the rate c\ depends only on the value, while the rate c 2 
- only on the state of the process. 
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3 More facts from jKRlj 



Consider the following continuous time Markov process DJl. Let there be 
M servers and N customers. The serving time is 77. The configuration of 
the system consists of specifying the numbers of customers rij, % — 1, ...,M, 
waiting at each server, plus the duration of the service time for every 
customer under service. Therefore it is a point in 



Upon being served, the customer goes to one of M servers with equal prob- 
ability 1/M, and is there the last in the queue. 

The permutation group Sm acts on Qm,n, leaving the transition proba- 
bilities invariant. Therefore we can consider the factor-process. Its values are 
(unordered) finite subsets of Q. It can be equivalently described as a measure 



We can identify such measures with the configurations of the symmetrized 
factor-process. Note that 

/ \ N 

So if we introduce the notation hA q (Q) C M. (f2) for the measures \x on Q 
for which (n) = q, then we have that v G Mn_ (Q) . We also introduce the 
notation M. n_ m (Vt) C A4n_ (Q) for the family of atomic measures, such that 

each atom has a weight jj for some integer k. 

A state of our Markov process is a probability measure on the set of 
configurations, i.e. an element of M. (Ai (Q)) . If the initial state of the 
process is supported by M. q (Q) , then at any positive time it is still the 
element of M (M q (O)) . A natural embedding M (O) C M (M (Q)) , which 
to each configuration v G A4 (Q) corresponds the atomic measure 8 V , will be 
denoted by 5. 



For /i = <5 U G M. yM.N_ M ($7) j to be the initial state of our Markov 
process, we denote by \i t the evolution of this state. Clearly, in general 
lit ^ 5 (M. ($7)) for positive t. This process is ergodic. We denote by ttm,n 
the stationary measure of this process. 







' M,N — 



{{u u ...,cu M ) G U^fy : n x + ... + n M = N} . 
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Let now k G M. q (fi) be some measure, let the sequences of integers 
Nj, Mj — > oo be such that jf- — > q, and let the measures G M. n 3 m (Q) be 

such that Vj — > k weakly. Consider the Markov processes /4 G .M I .M ^ (fi) 

\ JiJ' M i 

corresponding to the initial conditions 5 u j. As we just said, in general [i\ 

5 I M. ^ (O) ] for any j, once t > 0. However, for the limit // 4 = lim^oo ^ 

we have that fi t G M. {M. q iP)) , and moreover fi t G 5 (A^ g (fi)) , so we can 
say that the random evolutions \i\ tend to the non-random evolution K t = fi t 
as Nj, Mj — > oo. 

Therefore we have a dynamical system 

T t :M q (Q)^M q (Q). (15) 

This dynamical system fi t is nothing else but the non-linear Markov process, 
mentioned above. 

Another way of obtaining the same dynamical system is to look on the 
behavior of a given server. Here instead of taking the symmetrization of the 
initial process 971 on Qm,n, we have to consider its projection on the first 
coordinate, Qi, say. To make the correspondence with the above, we have to 
take for the initial state of this process a measure P on Qm,n, which is Sm- 
invariant, and which symmetrization is the initial state of the preceding 
paragraph. The projection of 9CT on Qi would not be, of course, a Markov 
process. However, it becomes the very same non-linear Markov process /x t in 
the above limit Nj, Mj — ► oo. 

We can generalize further, and study the projection of 3JI to a finite 
product, njLi%- Then in the limit Nj,Mj — > oo this projection converges 
to a process on HjLi%) which factors into the product of R independent 
copies of the same non-linear Markov process /i t . This statement is known as 
the "propagation of chaos" property. 

The main result of the present paper is that for every q the dynamical 
system fjTHjl has exactly one fixed point u c , c — c(q), and that it is globally 
attractive. In particular that means that tcn j: Mj p ci provided — > q as 
j — » oo and c = c(q) . 
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4 Main result 

Our goal is to show the following: 

Theorem 1 For every initial state v the solution X u (-) of the equation 

A(i/,A(.))=A(.) 

has the relaxation property: 

X u (t) — > c as t — > oo, 

where the constant c satisfies 

E u (N(u))=E Uo (N (u)). 

Moreover, fJ, Uj \„(.) (t) — > v c weakly, as t — ► oo. 

A special case of the above theorem is the following 

Proposition 2 Let T > be some time moment, and suppose that the func- 
tion A (•) satisfies 

A(0,A(-),-T) = &(-) (16) 



with 
Let also 

Then for some c > 



\(t) = b{t) for allt> 0. (17) 
J A (t) alt < C < oo. 
A (t) -> c as t -> oo. (18) 



Our theorem follows from the Proposition El immediately in the special 
case when the initial state v is of the form v = A*o,A(-) (^) f° r some A and some 
t > 0. These initial states are easier to handle, so we treat them separately. 

The heuristics behind the Proposition |21 is the following. One expects 
that if 

then the function b for large times is "closer to a constant" than the function 
A. More precisely, if t belongs to some segment [T 1; T 2 ], with T\ ^> 1, then the 
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dependence of b (t) on v is very weak, so b is determined mainly by A. One 
then argues that under that assumption sup tg [ Ti T2 ] b (t) should be strictly less 
than sup tg [ Tl)T2 ] A (t) . Indeed, one can visualize the random configuration of 
the exit moments yi-s as being obtained from the input flow configuration 
of Xi-s by making it sparser. Namely, we have to consider a sequence rji of 
i.i.d. random variables, having the same distribution as r], and then to move 
the particles x« to the right, positioning them at locations i/i, so that in the 
result 

Vi+i ~Vi>Vi (!9) 

for all is, see ()29|) . (JHUj) below for more details. However this is a very 
rough idea, since some particles need not be moved, due to the fact that (fTU|) 
may hold even prior to the sparsening step, in which case it will happen that 
y i+ i = x i+ i, while yi > Xi, and so the configuration becomes locally denser. 
(And if A is a constant, then b is this same constant, so again the above 
argument is not literally true.) 

To be more precise, we will show the following self-averaging property. 
Let the functions A (•) and b (•) are related by 

b(.)=A(0,X(.),-T). 

One of the main points of the following would be to show that for every x 
one can find a probability density q\. x (t) , vanishing for t < 0, such that 

b(x) = [\*q XiX ](x). (20) 

We then will show that this self- averaging property of the system implies 
(fTSj) . provided we know in advance certain regularity properties of the family 
{<?a,z}- Note that apriori the condition (j2*Uj) is not evident at all for our FIFO 
system: one has to rule out the situation that, say, the input rate function A 
is uniformly bounded from above by 1, while the output rate b is occasionally 
reaching the level 2; this is clearly inconsistent with (J2(Jj) . 
In general case, when 

b{-) = A(n,\(')), 

we have 

b (x) = (1 - e Ai/U (x)) [A * q x ^ x ] (x) + £A,/i (x) Q x ,n (x) , (21) 
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where E\ tfl (x) > 0, (x) — > as x — > oo, while (x) is a bounded term, 
see Section 8 for details. 

To get the above mentioned regularity property we will need few prepara- 
tory lemmas. 

Lemma 3 Let (■) be NMP, with N (fi U) x,( ) (*)) = N (v) = q. Then 

there exists a time moment T = T (q) and e = e (q) > 0, such that for all 
t > T 

(u = 0)„ m > e. (22) 

In words, the probability of observing the system [i v ,\ v (.) (t) to be in the idle 
state is uniformly positive, after some time T (q) . 

Proof. Let the initial state k of the NMP be such that N (k) = q. Then 
by JTUj), (HD, we have S («) < Cq. Consider now the GFP, started in k 
and having zero input flow, i.e. A = 0. We denote it by /i Kj o (t) . Consider 
the probability (N (u) > 0) M(t0 (t) that such a system is still occupied at the 
moment t. Then clearly 

S( K )>t (N(u)>0)^ o(ty 

Therefore 

(u = 0)„ m > 1 - — • 
In particular, if we put T = 2Cq, then for allt > T 

1 

= °)m k .oW ^ 2" 

Consider now the NMP started at k. Let us introduce the event 



£n(t) 

Then 



in the Poisson random flow, defined by the rate 
A K (•) , no customer arrives before time t. 



^ = L. K( ,(T)> Pr (^)^ = £ K (T) ) (23) 
= Pr (£„ (T)) (a; = 0) ^ > ^Pr (S K (T)) , 
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so we need an estimate on the probability Pr (£ K (T)) . This is easy, because 
of (HJ: 

Pr {8 K (T)) = exp |- £ \ K (t) dtj > exp {-TC ( V )} . (24) 

That proves our statement with T = 2Cq and e = exp {—TC (77)} /2, though 
thus far only for t = T. 

But in fact we are done! Indeed, for an arbitrary t > T let us take the 
state k = n t -r = /^,a„(-) (t ~ T) of the process ^ v ,k(-) (■) as the initial state 
of a new NMP, n K> \ K {.) (•) . Then for every r > T — t we have /4,,A„(-) (r) = 
A*k,a k (-) (r - (t - T)) , so in particular ^„ )A „(.) (t) = /U k ,a k (-) (T) . Since «t_ T e 
(fl) , we can apply ()23|). (J23|) and thus complete the proof. ■ 

Lemma 4 Le£ //„,*„(.) (•) 6e NMP ; u»'to N (<)) = N (y) = q. Then 

there exists a time moment T' = X" (q) and e' = e' (q) > 0, such that for all 
T > T" 

/ A„(t) dt< r(l-e'). (25) 

Proof. A configuration x of our process in the segment [0, T'] consists 
from 

i) the initial configuration (n, r) , drawn from the distribution \x\ 

ii) the random set < x% < ... < x m < T', which is a realization of 
the Poisson random field defined by the rate function X v (restricted to the 
segment [0, T"]), independent of (n, r); 

in) one realization r\\ of the conditional random variable (v — r rj > t\ 

and n + m — 1 independent realizations r)k,k = 2, n + m of the random 
variable rj. We denote by P '^\^. n (<i%) the corresponding (product) distribu- 
tion. 

Let A (x) C [0, 00) be the set on the real line, covered by the rods of 
X after the resolution of conflicts. Let B (x) — [0, 00) \ A (x) ■ Finally, let 
A (x) C A (x) be the set covered only by the last m rods, while C (x) = 
A (x) \ A (x)- A moment thought shows that 

E x Qf I A{x) (x) dx^j = J mes {A ( X )} F^ Xm (d X ) = jf A, (t) dt. (26) 
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Also 



Evidently, 



f T ' 

/ ( : A( X ) ( x ) + X s(x) ( x )) dx = T> - 
Jo 



E x (Ib(x) = P r {the system is idle at the moment x} . 

From the pervious lemma we know that E x (J-b(x) ( x )) > e f° r au ^ large 
enough. Therefore 



E v 



I 



Mx) 



(x) dx] < T' (1 - e/2) 



(27) 



once T" is large enough. Finally, 

fT' 



o 



I A (x) (a:) 



E v 



I 



c(x) 



(x) dx) — E : 



I 



(x) 



(28) 



Note that each of the last two expectations is the mean occupation time of 
our system when it is initially in the states ^ v ,\ v {.) (0) = v and ^ v ,\ v {-) (T') , 
while no extra input flows are present. Since N (u) = N (// I /,a„(.) (T')) = q, 
the difference between the expectations of these occupation times does not 
exceed 2(7, see (jTU|) . This, together with (j26H28j) proves our statement to 
hold for T' large, with e' — e/4. ■ 

We finish this section with a statement about the regularity of the exit 
flow. 

Lemma 5 Let the function p (t) satisfies the strong Lipschitz condition (0) ■' 
for some C 

\p(t + At)-p(t)\<Cp(t)At. 
Then the function b (t) is Lipschitz. 

Proof. Let t be fixed. The idea of the proof is to correspond to every 
elementary event, which contribute to the output rate b (t) , the elementary 
event, contributing to b(t + At) , by enlarging by At the service time of 
the customer, whose service ends at the moment t. This correspondence, 
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however, does not "cover" all the events, contributing to b (t + At) . Namely, 
the elementary events not covered by the above correspondence, are precisely 
those, for which the customer, whose service terminated at t + At, started 
his service after the moment t. 

Let us first estimate the probability it (t, At) of the event II (t, At) that 
some customer started to be served after the moment t, and was served before 
t + At. Consider an elementary event, contributing to II (t, At) . It is some 
configuration (xi, x n ; li, l n ) , where a certain rod 4 satisfies Ik < At. 
Comparing the collection of events { (xi, x n ; h, ...lk-i, h, In) '■ h < At} 
with the collection { (xi, x n ; h, ...lk-i, h, In) '■ h > At} (Peierls trans- 
formation), we conclude that 

f„ A * p (t) dt 
n (t, At) < < C p At 

J At p(t)dt 

for some C p < oo. 

Denote by ( (t) the random moment of the beginning of the service of the 
client, who happens to be the last one started to be served before t. Then 
one can define the rate 7t (x) for all x < t by 

Pr{C(t) G [x,x + Ax] } 

7t (x) = hm 



Ax^O Ax 



Then 



Clearly, 



Therefore 



poo 

b (0 = / It (t-x)p (x) dx. 
Jo 

POO 

b (t + At) = / 7 t (t-x)p(x + At) dx + n (t, At) . 
Jo 



POO 

\b(t + At) -b(t)\ <C p At+ / ~f t (t- x)\p(x + At) -p(x)\dx 

Jo 

POO 

< CpAt + CAt / it(t-x)p (x) dx 
Jo 



= C p At + CAtb (t) . 
Since b(-) is uniformly bounded, the proof follows. 
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5 The self- averaging relation 



Here we will derive a formula, expressing the function b (•) = A (0, A (•)) in 
terms of the functions A (•) and p (•) . This will be the needed self- averaging 
relation pijl . 

Theorem 6 Let the functions b(-) and A (•) are related by 

6(.)=A(O,A(0). 
Then there exists a family of probability densities q\ tX (t) , such that 

POO 

b(x)= X(x-t) q XtX (t) dt. 
Jo 

Proof. To see this we first introduce some new notions. 

Let li,...,l n > be a collection of positive real numbers, which we will 
interpret as the lengths of hard rods, placed in K 1 . A configuration of rods 
can be then given by specifying, say, their left-ends, x± < X2 < ... < x n , so 
that the rod k occupies the segment [xi,Xi + lj\ . This configuration will be 
denoted by a n (x l7 x n ; h, l n ) . 

In case some of the rods are intersecting over a nondegenerate segments, 
we say that such a configuration has conflicts. By a resolution of conflicts 
we call another configuration of the rods Zi, l n , where these rods have the 
following set z\ < z 2 < ... < z n of the left-ends: 

it is defined inductively by 

Zi = Xi, 

and 

Zi = max {zi-i + k-i,Xi} . (29) 
We will denote by y-s the corresponding set of the right-ends: 

y,i = Zi + k. (30) 

Any configuration with no conflicts, and in particular any configuration ob- 
tained by resolution of the conflicting one, will be called an r-configuration. 
The operation of resolving the conflict will be denoted by R, so 

0~n (^1) •••) %m ^1) •••5 ^n) R&n •••> ^ni l\i •-•> ^n) • 
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For any configuration a of rods we will denote by Y (a) the set of their 
right-ends. So, in our notations 



(yi, y n ) = Y (Ra n (x h x n ; h, l n )) 



Suppose now that the lengths li, l n , as well as the locations x±, . 

X\ , . . . , X n ~\ , l\ , 



and y are specified. We define the values X (y) = X \ y 
as the solutions of the equation 

y E Y (Ra n (x lt x„_i, X (y) ; l u /„)) 



- -En— 1 



■ •) In 



(31) 



Note that for the general position data (xi, x n _i; l\, l n ) the function 
X (y x\, x n -\] h,-..,lnj is not defined for some y-s of positive measure, 
while for some other y-s it is multivalued, having several (finitely many) 
branches, provided n > 2. (The case n = 1 is simple: X (^y 
Now we can write the desired formula: 



h 



b(y) = exp{-I x (y)} 



CO 



71=1 



X 



n 



y-k) 

(32) 



OO POO 



^0 



...y A (y x 1 ,...,x n -i]li,...JnjjY^X(x i )dx 



n-l 



l[p(k) dk 



i=l 



where 



A fx) dx. 



The integral in (|32p should be understood as follows: the range of integration 



X\ , . . . , x n —\ , , . . . , Z n 



IS 



coincides with the domain where the function X (^y 

defined, while over the domains where the function X is multivalued one 
should integrate each branch separately and then take the sum of integrals. 

In words, the meaning of the relation (|32|) is the following: for every 
realization xi,...,x n _i of the Poisson random field and every realization 
lx,...,l n of the sequence of the service times, we look for time moments 
X 



x(y 



Xi, x n _i; h, l n ) , at which the /^-customer has to arrive, 

so as to ensure that at the moment y some (other) customer will exit, after 
being served. In some cases such moments might not exist, while in other 
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cases there might be more than one such moment. If Xj are these moments, 
we then have to add all the rate values, A (JQ) , and to integrate the sum 
X(Xi) over all n and all x\, x n -\; l\, l n , thus getting the exit rate 

%)■ 

The first term (n — 1) in ()32|) is by definition the convolution, 



h (y) 



Since p (I) > and 



X(y-l)p(l) dl. 



p(l) dl < 1, 



(33) 



(34) 



we have indeed that b\ (y) < sup x<y A (x) in case when, say, the maxima of A 
are isolated, or when A is not a constant and the support of the distribution 
p is the full semiaxis {/ > 0} . We want to show that in some sense the same 
is true for all the functions 6„, defined as 



K (y) 



n-l 



A (X [y 



X{ } ... } X n —i, l\ } •••1 ^Tl 



i=i 



(y) 



Y[p(k) dh. 



i=i 



(35) 



The crucial step will be the analog of (jHljl for all n > 1, that is that 



b n (y) 



^{V ~ l )Pn (I) dl, 



with p n (I) > 0, Jq p n (I) dl y 1 for y — > oo. This turns out to be quite an 
involved combinatorial statement. 

Note that, evidently, the measure IliLiP(^) dh is invariant under the 
coordinate permutations in R"; therefore we can rewrite the expression (|33j) 
for the function b n (y) as 

b n (y) 



Xi, ...,X n _i; {/i, ...,/ n })) Yl \ I^y) ^ 



Y[p(h) dk 



1=1 



where the following notations and conventions are used: 



the (multivalued) function X ( y 



(36) 



Xx, {/i, l n }j by definition 

assigns to every y the union of the sets of solutions X (y) of all the 
equations 

y E Y (Ra n (xi, x n -i, X (y) —,l<x(n))) , (37) 
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with 7r running over all the permutation group S n (the notation l n } 
stresses the fact that the function X does not depend on the order of 



the entries of the set X (y 



Xi, 



n— 1) 



; {Z 1; l n } ) have to be counted 



with multiplicities, which for a given x £ X ( y 



Xi, 



, Xr 



-1, {h, In} 

is by definition the number of equations ()37|) with different tt-s, to which 
x is a solution; 

the integration in (jHUjl of the multivalued function means that each 
sheet should be integrated and the results added. Moreover, each sheet 
has to be taken as many times as its multiplicity is. 



Since each contribution A (^X (^y 



Xu 



, Xr. 



_i; li, Irij^j to (}35|) appears 



n\ times in (pjj) , we have to divide by n!. 

We repeat that while for some x-s, 7r-s and l-s the equation (|3Tj) might 
have no solutions, for other data it can have more than one solution. Clearly, 



the set X ( y 



have no other entries than those of the form 



Xi, ...,x n -i, {/i, l n } ) , for almost every data x%, x n _i, can 



■<<} 



XA,y,{h} = V 



E 

ieAc{l,2,. 



where A runs over all nonempty subsets of {1,2, ...,n} (i.e. at most 2 n — 1 
different entries). So the function X (y x±, ...,x n -i', {h, ...,l n }j, as a func- 
tion of xi, ...,x n -i, has to be piece-wise constant. It is not ruled out apriori 

xi, x n -\\ {/i, ...,/„} ) can be empty. This 



that for some data the set X [y 
is not, however, the case. Moreover, as the Theorem below states, 



Xn-i, {h, ...,/„}) , counted 



the number of elements in the set X yy x±, 

with multiplicities, is precisely n\ for almost every value of the argu- 
ments. 
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Therefore we have for the inner integral in (J36|) : 



—A (x (y | xi,...,x n _i;{/i,.. .,/„})) JJ ^ — <£r 

/" 1 n_1 /A 

= / ^7 fc(Ay,^i,-,^n-i;{ii,-,^n})A (xA,»,{ii}) n ( 7 

J ' Ac{l,2,...,n}, 1=1 ^ ' 



(v) 



where the integer k (A, y, x%, x n -\, {h, Z n }) is the multiplicity of the 
value XA, y ,{k} of the function X at the point (?/, X\, x n -\\ {h, Z n }) . Since 

A;(A,?/,a;i,...,a; n _i;{/i,...,/ n }) = n! 



Ac{l,2,-,n}> 
A^0 



a.e., we have 



/^i A ( x ( y I ^•••>^-i;{^--->w)) n (y^y^ 



Ac{l,2,...,n}, 



where 



^A.y ^ {Zi,...,z n }J 



(38) 



so 



<g Al2/ (^ {Zi, ...,/„}) < 1, with <&,v( A {h,-,ln}) = 1 



Ac{l,2,...,n}, 



(39) 

since the measures dxi are probability measures on [0, y]. (Note that the 
functions k (A, y, x±, ...,i„_i; {Zi, Z n }) do depend on the variables x±, x n _\\ 
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hence the measures q\ >y (■ {h, l n } \ indeed depend on A, y.) Therefore, for 
the function b n (y) we obtain a sort of a convolution expression: 



bn (y) 



/n 
[lx,y (a I {/!,...,/„}) A (x AMli} )] Y[p(k) dk. (40) 

Ac{l,2,...,n}, * i=l 



Be it the case that the probability measure q\ iV (■ {li,...,l n }\ is concen- 
trated on just one subset A = {1, 2, n} , we would obtain the usual con- 
volution 



K{y)= / A (y - I 



Q X\p(U) dk = \ *p* ... *p(y). 



i=i 

Here the situation is more subtle, and in (}4T)|) we have a stochastic mixture 
of convolutions with random number of summands. 

Taking into account the relations (|32*j). (|HB]). (flTi|). the result can be sum- 
marized as follows. Let v = v\,y be the integer valued random variable with 
the distribution 

Pr {u = n} = exp {-I x (y)} M^L, n = , 1, 2, 

and ?7i, 772, ••• be the i.i.d. random serving times. Consider the random func- 
tion ^\ yV = £\ >y (v\, y ; rji, T)2, •••) , such that its conditional distribution under 
condition that the realization v\, y ] Vii V21 ■■■ is given, is supported by the finite 

set 



L (v\, y ;r)i,m, •••) 
and is given by 



h>:Ac{l,2, u x>y +l} , A ± 1 C R\ 
lieA J 



Pr \ = I 771, 772,- > = {^i,-- ; ^A, y +i}) 



sec 



). Then the following holds: 

&(y)=E(A(y-£ A , y )). 
This is precisely the relation (j2l]|) . with being the distribution of £\ iV . 
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6 Combinatorics of the rod placements 



In this section we will prove the Theorem [71 which was used in the previous 
section. We will use the notation of the previous section, introduced at its 
beginning, up to relation (p?T|) . 

By a cluster of the r-configuration a n (zi, z n \ li, l n ) we call any max- 
imal subsequence Z{ < z i+ i < ... < Zj such that Zj = Zi + U + U + i + ... + lj-\. If 
Zi < z i+ i < ... < Zj is a cluster of an r-configuration, then the point Zi will be 
called the root of the cluster, while the point Zj will be called the head of the 
cluster. Note that for a general position configuration a n (xi, x n ; li, l n ) 
the point z$ is a root of a cluster of the corresponding r-configuration if and 
only if Zi = Xj. The segment [z iy Zj + lj) will be called the body of the cluster 
Zi < z i+ i < ... < Zj, and the point Zj + lj will be called the end of the cluster. 

The notation <r n (xi, x n ; /i, Z n ) U o\ (X, L) has the obvious meaning 
of adding an extra rod of the length L at the location X. Note though, that 
in general 

R [a n (xi, x n ; l u l n ) U a x (X, L)\ ^ R [Ra n (xi, x n ; h, l n ) U o x (X, L)\ . 

It is however the case, if the point X is outside the union of all bodies of 
clusters of Ra n (xi, x n ; h, l n ) . This will be used later. 

In what follows we will need a marked point in R 1 . For all our purposes 
it is convenient to chose the origin, G R 1 , as such a point. 

We will say that the resolution of conflicts in the configuration 
a n (xi, x n ; li, l n ) results in a hit of the origin, iff for some k we have 

y k = z k + l k = 0. (41) 

Such a hit will be called an x r -hit, iff the cluster of the point z k has its root 
at z r = x r . (Necessarily, we have that r < k.) An x r -hit will be called an 
(x r ,Xfc)-hit, if (}4*Tj) holds. 

Now we are ready to formulate our problem. Let n be an integer, and 
Ai < A 2 < ... < A n be a fixed set of positive lengths of rods. Let x\ < x 2 < 
... < x n -\ be a set of (n — 1) left-ends. We want to compute the number 
N (xi,X2, ...,x n -i, Ai, A2, A n ) , which is defined as follows. For any per- 
mutation 7r of n elements and for any X G R 1 , X 7^ Xi,x 2 , ...,x n -i we can 
consider the configuration a n _i (xi, ...,x n _i; A 7r( i ) , X^ n -i)) Ucti (X, X^n)) 
of rods, when the rods U = are placed at Xi,i = l,...,n — 1, while 
the free rod l n = A 7r ( n ) is placed at X. Given 71", we count the number 
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, x n -i, Ai, A n ) of different locations X, such that the correspond- 
ing r-configuration R [<7 n _i (x 1 , x n _i; A 7r( i ) , A^-i)) U <n (X, A^n))] has 
a hit, and moreover this hit is an X-hit. (In certain cases one cannot 
produce an X-hit by putting the rod l n = X^n) anywhere on R 1 ; then 
N n (xi, x n -i; Ai, A„) = 0. In certain other cases there are more than 
one possibility to place the free rod so as to produce an X-hit.) Then we 
define 

N (xi, ...,x n -i, Ai, A n ) = N n (x±, ...,x n -i, Ai, A„) . 

ir£S n 

Theorem 7 For almost every xi, x n ^i and Ai, A n , 

N(xi, ...,x n -i; Ai, A n ) = n\ 

Proof. Let us explain why the result is plausible. Let the set x±, ...,x n _i 
be given. Then we can choose the positive numbers Ai, A n so small that 
for any 7r the configuration 

0~n— 1 •••) 1 

; A 7r (i), A 7r ( n _i))U(Ti (X = — A 7r („), A^( n )) , having the (X,X)- 
hit, has no conflicts, while no other choice of X results in a hit. Therefore in 
our case N n (xi, ... ; Ai, A„) = 1 for every ir, so indeed 
X(xi,...,x n _i; Ai,...,A„) = n\. 

Now we explain why our result is non-trivial. To see it, take n — 2, 
#1 = —3, Ai = 1, A2 = 10. Then 

X 12 (xi;Ai,A 2 ) = 2 

- one can place the rod 10 at —10 or at —11. On the other hand, 

N 2 i (x 1 ;X 1 ,X 2 ) = 

- the rod 10, placed at —3, blocks the origin from being hit. Still, 2 + = 2!. 
Note that this example is a general position one. 

We will derive our theorem from its special case, explained in the first 
paragraph of the present proof. The idea of computing X (xi, Ai, A n ) 
for a general data is to decrease one by one the numbers Ai < A 2 < ... < A n , 
starting from the smallest one, to the values very small, keeping track on the 
quantities N n (xi, ...,x n -±] Ai, A n ) . During this evolution some of these will 
jump, but the total sum X (x±, ...,x n -i, X±, A n ) would stay unchanged, as 
we will show. That will prove our theorem. 
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We begin by presenting a simple formula for the number N n (x±, x n _i; Ai, .., A n ) 
Consider the rod configuration R [cr n _i (xi, x n -i, X^i), A^-i))] , which 
will be abbreviated as R n (Ai, .., A n ) = R w (A) . Let us compute the quantity 
S n (xi, x n -i] Ai, .., A n ) , which is the number of points yi EY (R n (Ai, .., A n )) , 
falling into the segment [— A^^O] . Then 



Ai, .., A n ) 



if the point — A 7r („) 
S n (x±, ...,x n -i] Ai, .., A n ) belongs to a cluster 

of R n (Ai, .., A n ) , 

S n (xi, ...,x n -i, Ai, .., A n ) + 1 otherwice. 



(42) 

Indeed, for every j/j, falling inside [— A„-( n ),0], there is a position 
Xj (zi, z n -i, yi, ...,y n -i) < 0, such that once the free rod X n ( n ) is placed 
there, the site yi is pushed to the right and hits the origin. In case the point 
—X n (n) is outside all clusters of R n (Ai, .., A n ) , placing the free rod A^) at 
Xo = — A 7r („) produces an extra hit. 
Now let A > be such that 

Ai < A 2 < ... < Xi-i <\i-A<Xi + A< A i+ i < ... < A n , 

i = 1, n, and some of the functions N n exhibit jumps in Xi as it goes down 
from Aj + A to Aj — A. We denote by A (8) the vector Ai, Xi + 5, A„. We 
suppose that A is small enough, so that for any n the difference 

\N n (xi, ...,x n -i\ X (A)) - N n (xi, ...,x n -i, X (-A))| 

is at most one. Moreover, we want A to be so small that on the segment 
A G [Xi — A, Xi + A] there is precisely one point, say Aj, at which some of 
the functions N n (x±, ...,x n -i, A) do jump. (In general, there will be several 
permutations 7r, for which such a jump will happen at A = Aj. Indeed, if we 
observe an (X, Xfc)-hit in our rod configuration with = A 7r ( i ), while we have 
that x\ < xi < ...x s -i < X < x s < ... < Xk < ... < x n -i, then in some cases 
we will have an (X, x/J-hit for every rearrangement of the rods l s , ...,lk, i.e. 
for all permutations of the form it o p, where p permutes the elements s, ...,k, 
leaving the other fixed.) 

Let us begin with the case when 

N n (xi, x n _i; A (A)) - N w (x u x n _ i; A (-A)) = 1. (43) 
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That means that N n (x%, x n _i; A (A)) > 1. So the intersection Y (R w (A (A)))n 

-A(A) w(n) ,o] ^ 0. Let y fc (A(A),7r) < ... < y r (A (A) , tt) are all the 
points of this intersection. The relation (|43|) implies via (}4"2*|) that the point 
Uk (A (5) , tt) leaves the segment —A , as 5 passes the zero value: 

Vk (A (5) , 7r) > -A (5) 7r(n) for5>0, (44) 
y*(A(0),7r) = -A(0) )r(B)l (45) 

y* (A (5) , tt) < -A (^ (n) for5<0. (46) 

Moreover, the point (A (5) , 7r) is not the end of the cluster. 

Therefore yu (A (5) , tt) = Zk+i (A (5) , 7r) . We now claim that if we assign 
the rod A ^° x ^+ii an d w iU take for the free rod the rod A {8)^+1)1 

then for the corresponding permutation the opposite to (|43j) happens: 

N^n^k+i) (a?i, • a: n _i; A (A)) - A^.( n ^ fe+ i) x„_i; A (-A)) = -1. (47) 

Here we denote by 7r (n «-> /c + 1) the permutation which is the composi- 
tion of the transposition n <-> + 1, followed by tt. Indeed, after the above 
reassignment and the resolution of conflicts, the rod A (S\^ n \ will be po- 
sitioned at the point (A (S) , tt) . The relations — (j4q) then tell us, 
that during the 5-evolution the right endpoint of this rod will move from 
the positive semiaxis to the negative one, thus adding one unit to the value 
fc+1) (xi, ••• A (A)). 

The above construction corresponds to every permutation tt, satisfying 
(|43|) , another permutation, tt' = $ (tt) , which satisfy (J47|) . We will be done 
if we show that $ is one to one. We prove this by constructing the inverse 
of $. 

So let tt' be such that 

N n > (xi, x n -u ^ (A)) - N n , (xi, x n -i, A (-A)) = -1. 

According to the above that means that the intersection Y (R n r (A (A))) D 
(0, +00) 7^ 0. Let yy (A (A) , tt') < ... < y r > (A (A) , tt') are all the points of this 
intersection. The relation (J4*3~j) implies via (J4*2~)) that the point yy (A (6) , tt') 
moves from the positive semiaxis to the negative one as 5 passes the zero 
value: 

y v (A (5) , tt') > for 5 > 0, 



29 



y w (A (0),vr') =0, 

y y (A (5) , tt') < for 5 < 0. 

But that precisely means that the point yy-\ (A (5) , n') is inside the segment 
-A (8) w ,r k ,\ ,0 for 5 = A, and outside it for 5 = —A. So if we assign the 

iree rod A (^) 7r /(„) to the point making the rod A (5)^,^ free, then we 
construct the permutation ir" = <3>' (tt') , for which (|43|) holds. 
The statement that $' is inverse to $ is straightforward. ■ 
Below we will need a version of the above theorem, which follows. Let T, L 
be positive reals, L < T. Let again n be an integer, and A x < A 2 < ... < A n 
be a fixed set of positive lengths of rods. Let — T < x\ < x 2 < ... < 
< be a set of (n — 1) left-ends. We want to compute the number 
iV (— T, xi, x 2 , ...,x n -i, L, Ai, A2, A n ) , which is defined as follows. For any 
permutation ir of n elements and for any X G (-T, 0) , X 7^ x±, X2, x n _i we 
can consider the configuration a n (-T, x±, i„_i; L, A vr (i), A„-( n _i)) Uo"i (X, A^^)) 
of rods, when the rod L is placed at — T, the rods U = A 7r (j) are placed at 
Xi, i = 1, n — 1, while the free rod Z n = A^m is placed at X, —T < X < 0. 
Given 7r, we count the number N w (— T, Xi, x 2 , x n -ij -^j Ai, A 2 , A n ) of dif- 
ferent locations X, such that the corresponding r-configuration 
R [a n (-T, xi, x n _i; L, A 7r (i), A^^-i)) U a\ (X, Kin))] has a hit, and more- 
over this hit is an X-hit. Then we define 

N (— T, x%, X2, x n _i; L, Ai, A 2 , A n ) = iV^ (— T, Xi, x 2 , x n _i; L, Ai, A 2 , A n ) 

Theorem 8 Suppose that 

L + Ax + A 2 + ... + A n <T. (48) 

T/ien iV (— T, xi, x 2 , x n _i; L, Aj, A 2 , A n ) = n\ for almost every xi, x n _i 
and Ai, A n . 

The theorem |H1 differs from the theorem by the presence of the addi- 
tional rod L, which is placed at — T, and by the restriction that all points 
X, xi, x 2 , x n -i has to be within the segment (— T, 0) . Therefore the rod L 
will not move under the resolution of conflicts. Without the restriction (j4*Hj) 
the statement of the theorem is not valid, as it is easy to see. 

Proof. Let the numbers < E\ < ... < e n _i be so small that the sum Ei + 
. ..+£ n _i is less than any of the numbers \5 (T — L) + ^Ai + <5 2 A 2 + ... + <5 n A ra | , 
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where are taking any of three values —1,0,1, with the only restriction 
that not all of them vanish simultaneously. Let us replace the configuration 
Xi,X2, ...,x n -i by the configuration x[, x' 2 , x' n _ ± , where 



Let k be the largest integer for which x\ > X{. (The meaning of the config- 
uration x[,x' 2 , ...,x' n _ l is the following: were all £j zeroes, it is the result of 
resolving the first conflict, between the first rod L and the rods intersecting 
it, which have to be pushed to the right-hand end of L. We use positive e-s 
in order to have all the point x\ different.) By the previous theorem we know 
that X (x[, x 2 , ...,x' n _ 1 ', Ai, A n ) = n\ . Let the location X be such that for 
some permutation ir the corresponding r-configuration 

R [a n -i (x[, ...,x' n _ 1 ; A^i), A^n-i)) U<7i (X, Xn(n))] has an X-hit. The con- 
dition (f4*KJ) implies that the cluster of the r-configuration 
R [a n -i (x[, x' n _ x \ A^i), A,r( n _i)) U ci (X, X n ( n ))] , rooted at X, does not 
contain any of the points z[ = x[, z' 2 , z' k (see for the notation), so 
X > L — T, and the r-configuration 

R [<T n (-T , X\ , • • • , X n —i , L, A 7r (i), K{n-i)) U 01 {X,\n(n))] has an X-hit as 
well. Therefore 

N (— T, Xi, X2, x n -i) L, Xi, X2, A„) > n! . On the other hand, if the r- 
configuration 

(!),..., A^-x)) U01 (X, \„( n ))] has an X-hit, then 
by the same reasoning X has to be to the right of the location L — T, and 
moreover the cluster of this configuration, rooted at X, does not contain any 
of the points z\ = — T, z 2 = —T + L, Zk+i] therefore the r-configuration 
R [cr„_i (x' l5 x' n _ x \ A 7r( i ) , A,r( n _i)) U 0i (X, A^)] has an X-hit. Hence 
N (-T, Xi,x 2 , x n -\\ L, Ai, A 2 , A n ) < n\ , and the proof follows. ■ 

7 Estimates on dissipators 

For the future use we have to estimate the densities q\, x (t) , entering into the 
relation b (x) = [X * q\ iX ] (x) . 

Lemma 9 




L-T + ei if Xi < L - T, 
Xj otherwice. 



Q\,y (t) > p (t) Pr {server is idle at the moment y — t} . 



(49) 
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Proof. We will obtain this estimate by invoking the initial relation (|32j) 
for b : 



^ 1 POO POO 

b(y)=e W {-h(y)}J2- ( rry/ - / 



/y ry ^ 
...y A (x (y x 1 ,...,x n -. 1 ;li,...,l^Y[\(x i ) dxi 



n-l 



Y[p{h) dU 



Namely, the contribution to the value q\ yV (t) comes from all realizations 



xi,...,x n -i;h,...,l n ) . Amon, 



Zi, /„) , for which y — t Gin/ 
such realizations let us pick the following class: the rod l n = t, while the rods 
of the configuration Ra n (xi, ...,i„_i; li, l n -i) does not cover the point 
y — t. Let us denote the indicator of the complement to the union of rods 
forming the set Ra n (xi, x n -\\ h, l n -i) by I X) i. Then we have 



OO j 

9a,, (*) > P (t) exp { I\ (y)} J2 7— 

n=l ^ 



OO POO 




ry ry n _ 

/ ••• / I x ,i (y- t) JJ A (a;,) ote 

Jo Jo i=1 



n-l 



n-l 



t=l 



p (i) Pr {server is idle at the moment y — t} . 



Next we establish the upper bound on qx )V . 
Lemma 10 

oo 

qx, y (t) < $>* n (*) Pr ^ n - !} . ( 50 ) 

n=l 

where N^' y is the random number of \-Poisson points in the segment [y — t, y] . 

In particular, for t < C there exists a constant C = C (C, p) , such that 
for all A, y 

Qx,y (t) < C. (51) 
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Proof. As above, we have 



q x>y {t)=exp{-I x {y)}J2 / - / 

n=i yo J Q 




n-1 




(\ n-1 
7 / i=l t=l 



where the values /3j are all solutions /3 of the equation 



X [y x 1 ,...,x n -i;h 



(52) 



and where we integrate only over the set < x\ < ... < < y, so we do not 
have the factorials any more. Note that the equation (|B*2*|) has solutions only if 
the configuration (x\, x n -\ \ h, ln-i) satisfies the condition I X) i (y — t) — 
1; in that case the solutions do not depend on all these for which 

Xi < y — t. Let us define the values (3j outside the event I X) i (y — t) — 1 as 
the solutions of 




where 




if Xi < y — t, 
li otherwice. 
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Replacing the indicator by 1, we have 

oo 

q\, y if) <exp{-/ A (y)}^ 



n=l 



oo poo 




ry ry ry ( \ n 1 

Jxi=0 Jx2 J X n -2 \ j J i=\ 



n-1 



n-1 



Y[p(h) dk 



i=l 



exp{-I x (y)+I x (y-t)}J2 



(53) 



n=l 



oo poo 




ry ry ry ( \ n l 

/ / - / £p(&) )H*(xi)dx 

Jy-t Jx2 Jxn-2 V j 1 i = l 



n-1 



n-1 



i=l 



where the x-integration is now taken over y — t < x\ < ... < a; n _i < y. Let us 
enumerate (3j in decreasing order. Then clearly (3\ = t, and the corresponding 
term in (jo^j) equals p (t) . The next solution, f3 2 , of the equation (jo^j) , exists 
only if lx < t and X\ <y — l\. Then /3 2 = t — 1±. The second term is therefore 



^ POO POO 

eXp {-I x (y)+I x (y-t)}J2 ■ 

n=2> J ° 



n-2 




oo / py—l 



\Jy-t 



A (xi) dx± 1 p (t — h) p (h) dl\ 



n-1 



n-1 



Y\ A (xi) dxi > Y\ V {k) dl 



J i=2 



i=2 



^ POO POO 

<e W {-I x (y)+I x (y-t)}J2 / - / 



n-2 




\Jy-t 



n-1 



A (zi) dxi ) p (y - 1 - h) p (h) dh 



n-1 



j J A (xj) tfaj > Y\ V (h) dl 



i=2 



i=2 



p* 2 (t) Pr {the A-Poisson field has at least 1 point in the segment [y — t, y]} . 
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So by induction we arrive to the bound (|5U|) : 

oo 

qx,y (t) < Y^P m (*) Pr { N t' V >n~l} = Qx,y (t) , 
n=l 

where N^ ,v is the random number of A-Poisson points in the segment [y — t,y]. 
To see (jBT|) , we use a rough form of (J5U|) : 

oo 

g Al , (t) < J>* n (t) . (54) 

n=l 

Let A = supjp (t) . Then it is immediate from (J53j) that for alH < C 

(0 < A ^1 + ^ Pr fa + ... + rj n < C} j , 

where r)i are i.i.d. random variables, distributed as rj. But the probabilities 
Pr fa + ... + rj n < C} decay exponentially in n. ■ 

We will need the compactness estimate on the distributions q^ y (t) . We 
will obtain them using the estimate (|50|) . As the following statement show, 
the estimate (joHj) is rather rough; we believe that all the moments of the 
distribution q\ y (t) of order less than 1 + 5 are finite. 

Lemma 11 Suppose that A is such that for some T' and e' > and for all 
T >T 

[ \ u (t) dt < T (1 - e') 
Jo 

(see P3j) ). Then for any b < | 

/•oo 

/ t b q x ,y (t) dt<C (A, 6) < oo, (55) 
Jo 

where C (A, b) depends on A only via T' and e' . 

Proof of Lemma 111! We are going to use the simple estimate: for 
every random variable ( and every x > 

Q(T) = Pr{C>T}<T-* E(|Cr). (56) 
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We also will need an estimate on t a q (t) dt, a < x, where q is the 
density of £. We have: 



t a q{t) dt = - t a d[Q(t) 



= A a Q (A) + a / t^Q (t) dt. 

J A 

To apply to (|5U|) we will use the Dharmadhikari-Yogdeo estimate (see, 
e.g. jFj, p. 79): if £j are independent centered random variables, then 



n 

E(i6+...+ar)<^ /2 E E (^ 



2+<5 



Here R = R(S) is some universal constant. Introducing & = ^ — 1 (see JUJ), 
we have (see ©) 

Q n (t) = Pr + ... + rj n > t} = Pr {£1 + ... + £ n > t - n} (57) 



<RM s (t-n)- {2+5) n l+& l 2 . 
To proceed, we use (joTIj) to write 

/"OO poo 
/ tV„(t) ^ < / t b Q X ,y(t) dt 

Jo JO 



(58) 



= / tbp * n (*) Pr - n ~ 1 } fl 

n=l L^O 

Note that E fiV t A ' y ^ < (1 — a)t once i is large enough. The first step is 



to write 



J t b p* n (t) Pr jiV t A,2/ > n - l} dt 



(59) 



< 



»(!+f) 



tV n (t) Pr { iV*' 2 ' > n - l) dt + / tV n (t) 



dt. 
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Now, using (foljj) and (fo7|) , we have 



t b p* n (t) dt < 



n 1- 



Q 



n 1 + — 
1 2 



+ bRM 5 n 1+s/2 
< Cn h - x - & l\ 



f- 1 (t - n) 



-{2+5) 



dt 



where C = C (a, 6, M s ) . 

The first term in (JoT?|) is negligible. To see that, we first observe: 

Lemma 12 Let < v < 1, and iV 1 ' 6e a Poisson random variable: 



Pr {iV^ = fc} = e - 



Then 



1 \2 

Pr{iV > < e~ * 

1 — 1/ 



provided n is large enough. 

Proof. Note first of all, that if x > and n > x, then 



k>n 

In our case we thus have 



-x *H < e -x^! ( * \ k = p - x x n i 



fe>0 



7l! 1- -£r 

n+1 



J^Pr{JV" = k}<e- 



(vn) n 1 



n! l — i/ 



fc>n 

By Stirling, for n large 

V Pr {N v = k}< _J_ e -"» J^__ 

_ (l-v+\nv)n 



k>n 



< 



1 - V 

1 (i-) 2 . 



1 - 1/ 



-e 2 



37 



Therefore, 



"(!+f) 







t b p *n ^ p r > n _ A 



(It 



< — e 2 " 



n 1 + 



2 J J 



Hence, the moment J °° t b (?A,y (£) rft is finite as soon as the series J2 n 
converges, which happens when b < f . That proves Lemma ITT1 ■ 



n 



6-1-5/2 



8 The self-averaging relation: general case 

Here we derive a formula, expressing the function b (■) = A (//, A (•)) in terms 
of the functions A (•), p(-) and the measure /i. This will be the needed self- 
averaging relation (J21)) . We remind the reader that /i is a probability measure 
on the set of pairs {(n, r)} U 0. 

Theorem 13 Let N (/i) = q, and the rate function A (•) satisfies the conclu- 
sions of the Lemma [7] and the relation fH?5j) : 

/ X v (t) dt < T (1 - e) for all T > T' > 0. 
Jo 

Then there exists the family of probability densities q\^ yX (•) , x > 0, and the 
functionals Ex.^ (x) and Qx.fi (x) , such that 

b (x) = (1 - £ A>jU (x)) [A * q x ^, x ] (x) + £x,n (x) Qx,» (x) . (60) 

Moreover, 

£ x,fi ( x ) — ¥ as x — > oo, (61) 
u>/w/e Qa,^ (#) < C ; uniformly in A, /i and x, once g, T" and e' are fixed. 

Proof. We start by defining the functional Ex,^ (x) . Note that the de- 
scription of the realization of our process up to the moment x consists of the 
following data: 
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i) the initial configuration (n, r) , drawn from the distribution /i; 

ii) the random set < X\ < ... < x m < x (with random number m of 
points), which is a realization of the Poisson random field defined by the rate 
function A (restricted to the segment [0, x]), independent of (n,r); 

Hi) one realization r/i of the conditional random variable (j) — t i] > t^J 
and n + m — 1 independent realizations i]k, k = 2, n + m of the random 
variable r\. We denote by P^a®?) the corresponding (product) distribution. 
The difference 1 — e XjU (x) is then just the P Mg) A«n?-P r obability of the event 



n+m 



J2vk<x. (62) 
i 

(If n — 0, then by definition we put r = 0; we put also Yli = 0.) 

The meaning of the decomposition (joTIj) can be explained now: the first 
term corresponds to the exit flow computed over those realizations where the 
relation 1)62)1 holds, while the second term represents the rest of the flow. 

Let us show (JHIJ) , that is that 

{n+m ^ 
rjk > x > — > as x — > oo. 

To do this, we introduce two independent random variables: 

n n+m 
1 n+1 

Then for every a G (0, 1) we have 

( n+m 

Pri J2 Vk >x\=Pi{3 lt + 3 x >x} 



i 



< Pr {S^ > ax} + Pr {S x >{l-a)x}. 



Indeed, if S u + S\ > x, then either S u > ax, or else S\ > (1 — a) x. Since 
E < CM-g, the probability Pr {5 M > ax} goes to zero for every a positive, 
as x — > oo, uniformly in For the second term we have 



Pr{S A > (1 -a)z} 

°° / roc \ 

= J2( P* m ( f ) dt\Pr{N x ' x 

m=1 V-'(l-a)x / 
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Here N x,x is the random number of points in the realization of the Poisson 
field in [0, x] . Note that E (N x > x ) < x (1 — e') once x > X". Therefore we can 
apply the same argument which was used in the proof of Lemma ^2 when 
showing that the integral Q\ iV (t) — ► as T — > oo, see (J5Uj) . It implies 
that Pr {5a > (1 — a) x} —>■ once a is small enough, uniformly in A. 

Next we define the distributions q\m,x- They are constructed from the ran- 
dom field of the rods {rj k , k — 1, n + m} , defined above, placed at locations 

1 

0, ...,0, X\, ...,x m > , via the procedure of resolution of conflicts, defined in 

the previous section. To do it we first introduce the rate bi (x) to be the exit 
rate of the conditional service process under the conditions that 

n n+m 

^2 Vk = L, ^ Vk < x - L. (63) 

1 n+1 

We claim that for some probability distributions q\ t L,x we have 

b L (x) = [A * q x , L ,x] (x) . 
The distribution q\^ x is then obtained by integration: 



q\,/j,,x — J 9A,Z,asIV®A®»7 ( Vk G dL 



(The random variable Yli Vk is of course independent of the Poisson A- 
field.) The output rate bi (x) corresponds to the situation when we have 
customers arriving at the moments 0, x±, x m , which have serving times 
L,r] n+ i, ...,r] n+m , and which satisfy the relation 



n+m 



L+^rjk < x. 



n+1 



So we have to repeat the construction of the Section 5 in the present sit- 
uation. Few steps require some comments. The transition from the rela- 
tion (J55J) to (JSfiJl uses the fact that for any s the measure Yli=i P (h) dh is 
invariant under the coordinate permutations S s in R s . But the same S m 
symmetry evidently holds for the conditional distribution of the random vec- 
tor |(%, k = n + 1, ...,n + m) Y^Z+i r l k < x ~ ^} > since both the uncon- 
ditional distribution and the distribution of the condition are SL, -invariant. 
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The next crucial step was the relation (|39|). stating that the functions q\ tV 
are probability distributions. It was based on the theorem [7| The situation 
at hand is somewhat more delicate, since the rods we are dealing now with, 
are of two kinds: the first one has a non-random length L, produced by the 
initial state /i, while others are situated at the Poissonian locations {x{\ , 
defined by the rate function A. However, under condition Yln+T Vk < x — L 
the needed combinatorial statement (about m!) still holds, and is the content 
of the theorem |H| These remarks allow one to carry over the construction 
of the previous section, and so to establish the existence of the probability 
densities q\,L,x, and thus also q\ ttl ,x- The upper and lower estimates on q\^ x 
are obtained in the same way as were the estimates for q\^ x in the preceding 
section. 

The function Q\ tfJi (x) is the rate of exit flow of our process, conditioned 
by the event 

n+m 

22 Vk > X. 

1 

The boundedness of the Q\ ilA (x) follows from the following property of the 
service time distribution p (x): for every x,r, x > t > 0, 1 > t > 



<c , 



p(x + t) 



P (x — T 


V > Tj 


P \ X — T + t 


r] > rj 



< C. (64) 



The relation (jMj) follows easily from the condition (jHJ) . To explain the bound- 
edness, consider the elementary event 

(n, r) x {x h x m : < X\ < ... < x m < x} x {r)x, r] n+m } , 

which contributes to the output flow inside the segment [x, x + Ax] , which 
flow is accounted by the second term of (|6()jl. That means that our rod 
configuration produces after resolution of conflicts a hit inside [x, x + Ax] , 
and also that 

n+m 

22 Vk > x. (65) 
i 

In the notation of the Section 6 it means that after resolution of conflicts 
the endpoint yu of some (shifted) rod fits within [x, x + Ax] , for some k e 
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{l,...,n + m}. Let k be the smallest such index. But then the elementary 
events 

(n,r)x{xi, ...,x m : < x 1 < ... < x m < x}x{rjx, ...,?7fc_i,^ + t, r] n+m } , 

with any £ G (Ax, 1) , do not contribute to the output flow inside the segment 
[x, x + Ax] , while still satisfying Therefore, due to (|51jl. the probability 
that the customer would finish his service during the period [x, x + Ax] , is 
of the order of Ax, and, moreover, 

Q\,v (x) < 

■ 

Let now 971 G.M (-M g be some invariant measure of the dynamical 
system ffi3j) . Then 9Jt-almost every state /2 G A4 g (fi) belongs to the family 
{fit : — oo < t < +00} , such that for all r > 0, all t 

%-{h) = fit+r- 

Let us fix one such family {fit}- Then the function A (t), —00 < t < +00, 
which for every —00 < r < +00 satisfies on [r, +00) the equation 

A(-)=A(/} T ,A(-),r), 

is well defined. Then, according to the equation (JBTiJ) , for every r, —00 < 
t < +00, and for all x > r 

A (x) = (1 - £a,At ( x )) * ?A,Ard (z) + £a,a t (z) Qa.At (x) . (66) 

One would like to pass here to the limit r — > — 00. According to (}6*Tj) , for 
every x we have £a,/i t (^0 -* as r ^ —00. Moreover, it is not difficult to 
show that in the same limit q\^ T ,x (•) — * Qx,x (') • So the following equation 
holds for A : 

A (x) = [A * q x )X ] (x) , —00 < x < +00. (67) 

By the methods developed below one can show that every bounded solution 
of (J67|) is a constant. Since, however, we are proving a stronger statement, 
that the dynamical system T T has one fixed point on each hA q (Q) , which is, 
moreover, globally attractive, we will not provide the details. 
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9 Self-averaging =>* relaxation: a warm-up 



Before presenting the general proof that self-averaging implies relaxation, we 
consider the following simpler system: we have infinitely many servers, with 
service time 77, its distribution given by the probability density p. As the 
customer comes, he chooses any free server, and is served, leaving the system 
afterwards. The inflow is Poissonian, given by the rate function / (x) . If 
we impose the condition that the customers are coming at the rate they are 
living the system, we get the non-linear Markov process. The self-averaging 
relation (J2Uj) in such simplifies to 

b ( x ) = [f*p] (x) . 

Lemma 14 Let p(x) be some smooth probability density, suppp = [0,1]. 
Let f be a positive bounded function on K 1 , with f (x) < C for x G [1—, 0). 
Suppose that 

f *p(x) — f (x) for all x > 0. (68) 
Then f (x) — > c as x — > 00, for some c > 0. 

Proof. Let us first show that for every function p > on R 1 , (p = for x 
outside the segment [1—, 0) there exists a function f v on K 1 , satisfying (|55|) . 
which coincides with (p on [1—, 0). To construct such a function consider the 
sequence /„ of functions, defined inductively by 



fn+i (x 



fo = <P, 

ip (x) for x < 0, 

[fn*p] (x) for X > 0. 



A straightforward check shows that the sequence f n (x) is non- decreasing 
for every x, and that /„ (x) < C for all n and x. Therefore the function 
f v (x) = lim 

n—>oofn (3?) is defined. Clearly, it satisfies ()68j). This function is 
given by the formula 



U 0) 



[<p * p] (x) + 



ip *p 



(x) for x > 0, 



,0 ° ^*n\ 

I ' ■ l . -' 

p (x) for x < 0. 

(69) 

(Note that for every x the sequence p* n (x) decays exponentially, so the last 
expression is well-defined.) 
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Let us show that the function /, satisfying (JB8J) . is uniquely defined by its 
restriction to [1— ,0). Indeed, let g be another such function. Then h(x) = 
f (x) — g (x) is bounded in absolute value and satisfies 

h (x) = for x < 0, 

h * p (x) = h (x) for all x > 0. 
But then h *p* n (x) = h (x) for all x and for all n. Since for every A we have 
fo P* n i x ) dx — > 0, as n — > oo, it follows that h = 0. 

Let us show that the function 



s ( x ) = 



* n 'x) 



n=l 



goes to the limit as x — > oo; together with (joTJj) it would imply our statement. 
We will compute that limit, 5* (rj). For that we will use the local limit theorem 
approximation for the convolutions p* n (x) . Let m be the mean value of rj, and 
v be its variance. Denote by quy (') the density of the normal distribution 
with the mean M and the variance V. Then easy calculus computations tell 
us that 

S (rj) = lim } q km ,kv (Nm) = 2 lim ) q km ,kv (Nm) 

k>N/2 k>N 
= 2 lim ^ 1 c -(Nm-km) 2 /2kv = 

N ~*°° k>N ^ 2lTkv m ' 

Therefore the limit 

-j^ r+oo 

lim L (x) = — [if* p] (x) dx. 
x^oo m j 

■ 

In a special case when 

(f (x) = 1 + x on [—1, 0] , 

and p (x) is the uniform distribution on a segment [0,1], there is another 
formula for f v : 

0<k<x 
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f 


(1 + x) 


*p 


/o 




[-1,0] 



(We got it together with Prof. O. Ogieveckij.) It satisfies the equation: 

f(x)=[ f (x) dx, x > (70) 

with the initial data 

f (x) = 1 + x 

on the segment [—1,0] . Note that at x — it has a jump, from 1 to |. It 
becomes more and more smooth; in the non-integer points it is analytic, but 
at the integer point n it has n — 1 derivatives. 

It is bounded, and it goes to | as x — > oo, since m = | and 

(x) dx = -. 

K ' 3 

But to see analytically that this series defines a bounded function, and, more- 
over, 

1 + x - > 1 - , (x - k) k e x ~ k -> - as x oo 

0<fc<x 

seems to be quite hard. So, it looks amazing, that the above arguments give 
relatively simple proof of this convergence, which proof is probabilistic! 



10 Self-averaging =^> relaxation: probabilis- 
tic proof? 

As we know, any function A, defined for x < 0, and vanishing for x < —T, 
can be uniquely extended to x > in such a way that the relation 

A(0,A(-),-T) = 6(-) 

holds with b (x) = A (x) for x > 0. Therefore for every x > we have 

A (x) = [A * q XiX ] (x) , (71) 

where q\ tX (•) is a probability density supported by the semiaxis {y > 0} , and 

which is defined only by the restriction A .Our goal is to show that 

{y<x} 

flTTj) implies that A (x) relaxes to some constant c as x — > oo. 
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Since the distributions q\ jX depend on A (•) in a very complicated way, 
we have to treat a more general statement. Suppose a family of probability 
densities q x (•) , supported by the semiaxis {y > 0} , is given, where x > 0. 
Let / (x) be a non- negative function, defined on K 1 , such that 

f(x)<C for x < 0, 

/(*) = [/ fo">0. (72) 
One would like to show that 



lim / (x) = c, (73) 

x— >oo 

for some c > 0. That will imply the relaxation needed. 

Motivated by the analysis of the previous section, we will study the equa- 
tion (J72j) by considering the corresponding inhomogeneous Markov random 
walk. Unfortunately, the relation (J73)) does not follow from (J72j) in general, 
and the reasons are probabilistic! Before explaining it let us "solve" (|72|). 

So, let the family {q x ,x > 0} be given; we solve (J72|l for /, given its 

restriction / . We do this in close analogy with the previous section, 

{x<0} 

see (jnHJ). We put 

/ (x) for x < 
for x > 0. 



fo(x) 
We define 



fn+i (x) 



f (x) for x < 0, 

[fn * Qx] (x) for x > 0. 

Then for every a; the sequence /„ (x) is increasing, and the function / (x) = 
lim^^oo /„ (x) solves (JZ2I)- 

To proceed, it is convenient to rewrite the function / in a different way. 
We define 

„ u\-f * Qx] (x) for x > 0, 
^ 1 j ~ 1 for x < 0, 



#n+i (ar) = [flfn * Qx] (x) 



Then for x > we have 



f( X ) = y^,9n (x) 



n>l 
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Now we will write the formula for g n in terms of convolution. To simplify 
the exposition we consider the case n = 5, say. 

95 (x) = [g 4 * q x ] (x) 
= J 9a{x-u) q x (u) du 

= J 93 (x -u-v) q x ^ u (v) q x (u) dudv (74) 

= J g 2 (x - u-v -w) q x - u - v (w) q x - u (v) q x (u) dudvdw 

= J g\{x-t) q x - u - v - w (t-u-v-w) q x - u - v (w) q x - u (v) q x (u) dudvdwdt. 

Motivated by the last line we will introduce now for every x > the fol- 
lowing family of d.d.d. (dependent, differently distributed) positive random 
variables Xi,X2,Xa,- : 

the distribution of xi is given by the density q x (•) , 

the conditional distribution of X2 under condition xi is given by the den- 
sity q x ^ Xl (■), 

the conditional distribution of X3 under condition Xi>X2 is given by the 
density q x - Xl - X2 (•), 
etc. ... 

To make this definition complete, we put q x (•) to be the uniform distribution 
on [0, 1] for all negative x-s; note that this extension does not contribute to 
(J22J), since the support of all the functions g^ is the positive semiaxis. 

Hence we are led naturally to consider for every x the sums 9i = Xi + 
X2 + ••• + X%) if we denote by p x ^ the probability density of 6 i} then we have, 
by (dJ): 

9n+i (x) = [ gi * p x n) ] (x) . 
Summarizing, we have for x > : 

/ (x) = 9l (x) + p^} (*) ■ 

n>2 

The distributions p\ ^ are describing the following non-stationary Markov 
chain: at every point t/ G I 1 we are given a probability distribution q y (-), 
which has to be interpreted as the transition probability to make a move once 
in y. So we start at some x, and we make a (random) move — Xi, where Xi 
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is distributed according to q x (•) . Arriving thus to x — Xi> we make a second 
move — X2, where X2 is distributed according to q x - xi (•) , and so on. Clearly, 
the local limit theorem for this chain would imply (|73|) . 

We have to note, however, that the relation between the validity of the 
local limit theorem for this Markov chain and the validity of the relation (J73*|) 
is more complicated. First of all, the CLT for 9i might not hold, notwith- 
standing that the family q y (•) have very nice compactness properties. To 
give one example, consider the family of probability densities u x if) , x G WL 1 , 
where all u x (•) have for their support the segment [0, 1] , and satisfy there 
< c < u x (t) < C < oo, uniformly in x and t. We define now 

q x (t) =u x (t- {x}) , 

where {•} stays for the fractional part. Then all q y (-)-s have their sup- 
ports within the segment [0,2] . But the random variables 9% do not have 
CLT behavior! Indeed, the random variable 9i, is localized in the segment 
[[x\ — i,[x\ — i + where |_'J denotes the integer part. Nevertheless, for 
this example it can be shown that the relation (J73|) still holds, and that 
involves certain statement of the type of Perron-Frobenius theorem for our 
Markov chain. Further modification of this example, when 

q x (t) = u x (t - {x} - 1) , 

results in the Markov chain with two classes, and in this case both the CLT 
and the relation ()73|) fail. 

We conjecture here that the CLT theorem for the sums 9i holds, if the 
family q x (•) of transition densities has the following additional property: 

• For some k, K, < k < K < oo, 

k < < K, (75) 

" q, 2 (*) 

provided at least one of the values q Xi (t) is positive. 

The condition (fTHJ) is reminiscent of the positivity of ergodicity co- 
efficient condition, introduced by Dobrushin [Dj in his study of the limit 
theorems for the non-stationary Markov chains. 

In what follows we will take another road, and we get the relaxation 
property by analytical methods, which seems in our case to be simpler. But 
we still use probability theory, though not the CLT. It would be interesting 
to obtain the desired result by proving the corresponding limit theorem. 
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11 Self-averaging =>* relaxation: finite range 
case 

In this section we prove the relaxation for the solution of the equation (|72j) 
in the finite range case. 

Theorem 15 Suppose that 

0<f(x)<Cforx<0, 
f (x) = [f * Qx] (?) for x>0, 

while the following conditions on the family q x hold: for some T 

[ q x (t) dt = 1 
Jo 

for all x, and 

C>q x (t)>K (t) > (76) 
for < t < T, with continuous positive k (t) . Then the limit exists: 

lim / (x) — c > 0. 

x— >oo 

The property (J76)) holds for the NMP, as follows from the relations (J49|) 
and J22J) . 

Proof, i) We know that the function / is continuous and bounded, 
< / < C. So if there exists a value X such that / is monotone for x > X, 
then the function / has to be constant for x > X + T, and we are done. So 
we are left with the case when the function / has infinitely many points of 
local maxima and local minima, which go to oo. 

ii) Given a local maximum, xo, we will construct now a sequence Xi of 
local maximums, i — 0, — 1, —2, — n = —n (/, Xq) such that 

• Xo > X-i > X-2 > 

• Xi — Xi-i < 2T, Xi — Xi_2 > T for all i, 

• < x_ n < 2T, 

• / (xi-i) > f (x) for any x^ < x, and / > / (a*) , 
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• for every x G [xi-i,Xi — T] we have f (x) > f (xi) (of course if the 
segment is non-empty). 

The construction is the following. Let x be some point of local maxima. 
Since 



we have / (xq) < F (xq) = sup {/ (x) : x G [x — T, x ]} , unless / is a con- 
stant on [xo — T, xq] , in which case we are done. Let 

y = inf {x G [xq - T, x ] : / (x) = F (x ) = sup {/ (x) : x G [x - T, a; ]}} . If 
y > xq — T, or if y = xq — T and is a local maximum, we define x-i = y. 
In the opposite case we have that the point x$ — T is not a local maxi- 
mum of the function / on the segment [x — 2T, Xq — T] . We then consider 
two cases. In the first one we suppose that the function / on the segment 
[xq — 2T, x — T] takes values below F = /(xo)+ ^°~ T) . Let [y,x -T\ C 
[xq — 2T, xo — T] be the largest segment for which the inequality / (x) > F 
holds for every x G [y, Xq — T] . We define x_i to be the leftmost point 
of maximum of / in [y, Xq — T] . In the opposite case we consider the set 
S = {x G [xq — 2T, x — T] : / (x) > f (x — T)} . It contains other points 
besides x — T. However, it can not contain all the segment [x — 2T, x — T] . 
Since / is not a constant on [x — 2T, x — T] , sup 5 f > f (x — T) . Let z G 
(xo — 2T, x — T) be such that / (z) < f (x — T) . Let S± — S C\ [z, xo — T] . 
We necessarily have that sup Sl f > f (x — T) as well. We define X-i to be 
any point in Si where / (x-i) = sup Sl /. Clearly, x-i is a local maxima of /, 
while x — X-i < 2T. 

We proceed to define the sequences x« by induction, i = 0,-1,-2,..., 
until we arrive to a first value below 2T, where we stop. 

in) In the same way, starting from a local minima y , we can construct a 
sequence y t of local minima, such that 

• 2/0 > y-i > y-2 > 

• y%- Vi-i < 2T, yi - y^ 2 > T for all i, 

• < y- n < 2T, 

• / (Vi-i) < f (x) for any y^i < x, and / (y^i) < f fa) , 

• for every x G — T] we have f (x) < f (yi) (if the segment is 
non-empty). 
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We can suppose additionally that Xq > yo > x_i. 

iv) Note that the (finite) sequence Xi do depend on the initial local minima 
xq, which was used for the starter. The bigger xq is, the longer the sequence 
Xi is. So let us introduce the sequence Xq of such starters, and we suppose 
that Xq N ^ > N. In that way we will obtain the family x of sequences of local 
maximums of /, i — 0, —1, — n Xq N ^ , with n ^f, x^^j — > oo as N — > 

oo. (Of course, in well may happen that for different N-s the corresponding 
sequences share many common terms.) 

Denote by M the limit lim inf tv^oo ,/ (-^o^) • ^ n the same wa y we can 

introduce the limit m = limsup^^^/ (^^0 ' Clearly, M > m, and if we 
can show that M — m, then we are done. So we suppose that M — m > 0, 
and we will bring that to contradiction. 

v) Let us fix e > 0, e < M ~ m , which is possible if M — m > 0. Then one 

can choose iV so large, that at least 99% of terms of the sequence / (^l-i) — 

/ (x^ j are less than y. We will fix that value of N, and we will omit N from 

our notation. Therefore without loss of generality we can assume that for 
some i (in fact, for many) we have / (x) < f (xj) +e 2 for all x G [xj — T, Xj] . 
Therefore for the set K = {x E [x^ — T, x t ] : / (x) > / (xj) — e} we have: 

/ fei (t) dt > 1 - e. (77) 

JK-(xi-T) 

Hence, for its Lebesgue measure we have 

1 - e 



mes {K} > 



C 



Consider now the corresponding sequence of minima, {y^} , and the seg- 
ments [y k — T, y k ] . We claim that the set K has to belong to the union of 
these segments. That would be evident if the segments in question were 
covering the corresponding region without any holes. However, that is not 
necessarily the case, and there can be holes between the segments, since in 
general the differences yi — y^i can be bigger than T. Yet, this does not 
present a problem, since by construction the function / is smaller than m 
outside the union of the segments [y k — T, y k ] , which implies that the set 
K indeed is covered by these segments. Since diam (K) < T, there exists 
k = k(K) , such that K C [y k -i - T, y k -i] U [y k - T, y k ] U [y k+1 - T, y k+1 ] . 
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Without loss of generality we can assume the set K "fits into [y* — T, y fc ]", 
in the sense that 

r T ^ r m nies {if} 1 — £ 
mes {K n [y fe - T, > ^ > — , 

while we have / (x) > f (yk) — £ 2 for all 16^- T, y^] . So we have 

f q yk (t) dt>R (J-=I ) , (78) 

where we define the function k (a) by 

R (a) = inf / k (t) dt. 

Ac[0,T]:mes{A}>a J A 

By construction, the set Kn[yi~ — T, y^\ is disjoint from the set L C [yk — T, yk] 
which is defined by L = {x G [yk — T, yk] : f (x) < f (yk) + s} ■ Since 

/ (yk) = f {yk - *) q Vk (t) dt, 
Jo 

we have similar to (|77jl that 

/ ?„„ (*) > 1 - e- (79) 

JL-(y k -T) 

But since (£) is a probability measure, we should have that 

1 - e 



+ 1-£<1, 



3C 

because of (I7H|) . (fTHj) . This, however, fails once e is small enough. 



12 Self-averaging =^> relaxation: infinite range 
case 

We return to the equation ([Z21) , / (a?) = [/ * Qx] (x) ■ Now we will not suppose 
that the measures q x have finite support. Instead we suppose that the family 
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q x has the following compactness property: for every e > there exists a 
value K (e) , such that 

fK(e) 

/ q x (t)dt>l-£ (80) 
Jo 

uniformly in x. We will also suppose that for every T the (monotone contin- 
uous) function 

F T (5) = inf inf / q x (t) dt (81) 

x DC[0,T]:J D 
mesD><5 

is positive once 5 > 0. Finally we assume that the family q x is such that 
the function /, with solves ()72|) , is Lipschitz, with Lipschitz constant C = 
C ({q.}) ■ As we know from the Sections 4 and 7, these conditions are indeed 
satisfied in the specific case of the non-linear Markov process and the equation 

dm) - 

12.1 Approaching stationary point 

Lemma 16 i) Let M = \imsup x _^ OQ f (x) . Then for every T and every e 
given there exists some value K\, such that 

inf f Cx) > M — e. 

ii) Let m = lim inf x ^oo f (x) . Then for every T and every e given there exists 
some value K2, such that 

sup / (x) < m + e. 

x&[K 2 ,K 2 +T] 

Moreover, the conclusions of the lemma remains valid if the function f sat- 
isfies a weaker equation (see d^TJ ) 

f (x) = (1 - £ (x)) [f * q x ] (x) +e(x)Q (x) , (82) 

with e (x) ^0 as x — > 00 and Q (•) < C. 

Proof, i) Let 5 > 0. Then there exists a value S > 0, such that for all 
x > S we have f (x) < M + 5, and e [x] Q (x) < |. Further, there exists a 
value R > S, such that for all y > R 

q y (t) dt < 5, 

n-s 
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see ()8U|) . Finally, there exists a point y > R + T, such that / (y) > M 
Due to the equation (JH2J) we have 

-v-s 



/(y) = (l-e(y)) 



f{y-t)q y {t) dt+ / f(y-t)q y (t) dt 
ly-s 



+£ (y) Q (y) 



Let A > 0, and A = {iG - T, : / (x) < M - A} , while a = J A q y (t) dt. 
We want to show that the measure a has to be small for small 8. Splitting 
the first integral into two, according to whether the point y — t is in A or 
not, we have 



M - 5 < a (M - A) + (1 - a - 8) (M + 5) + 6C, 
.C + 2-M 



so 



a < 8- 



A 



which goes to zero with 8, provided A is fixed. Therefore 

.C + 2-ikf 



mes {A} < F T l \ 8- 



A 



(see (fRTjl ). Since F^ 1 (u) — ► as u — >• 0, that proves that for any given A the 
Lebesgue measure mes {A} — > as 8 — > 0. Since the function / is Lipschitz, 
we conclude that infa. e [j,_x,y] / (a;) > M — A — Cmes {A} > M — 2A, provided 
5 is small enough. Taking A = e/2 finishes the proof. 

ii) Let 8 > 0. Then there exists a value S > 0, such that for all x > S we 
have / (x) > m — 8. Again, take R> S, such that for all y > R 



R-S 



q y (t) dt > 1 - 8. 



Finally, there exists a point y > R + T, such that / (y) < m + 8. Due to the 
equation we have 



/(y)>(l-x) 



/ - t) q y (t) dt+ f(y-t)q y (t) dt 



y-s 



(83) 



where x can be supposed arbitrarily small. Let A > 0, and 

A = {t 6 [0, T] : / (y - t) > m + A} , while a = (t) rft. We want to show 

that the measure a has to be small for small 8. Splitting the first integral 
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into two, according to whether the point y — t is in A or not, and disregarding 
the second one, we have 

m + 8 > (1 - x) [a (m + A) + (1 - 5 - a) (m - 5)] . 

For h so small that x [a (m + A) + (1 — a — 5) (m — 5)] < 5, we have 

m + 25 > a (m + A) + (1 - a - 5) (m - 5) , 

so 

r m + 3 
a < o — : — , 
A 

which goes to zero with 5, provided A is fixed. Therefore 



mes {A} < 1 (^5 



m + 3 



A 

and the rest of the argument coincides with that of the part i). ■ 
12.2 Absorbing by stationary point 

We now will show that if / satisfies (|72|l , then the property va$. x e[K,K+T\ f ( x ) — 
M — e implies that for all x > K + T 

f{x) >M-e-c(T), (84) 

with c (T) — > as T — > oo. That clearly implies relaxation. (Note that we do 
not claim that (|H4*|) holds for the solutions of (jH^j) ) . We will show it under the 
extra assumption that the distribution p (•) has finite moment of some order 
above 4. This assumption, as well as (|57jl below, will be used only throughout 
the rest of the present subsection. 

Using the linearity of (|72j) , we will rewrite our problem slightly, in order 
to simplify the notation. 

Let the function / > satisfies / (x) = [f * q x ] (x) for x > 0, and 

i) f{x)>l for x E [-T, 0] , 

it) for some /3 > 1 and B < oo and for every x we have 

/"OO 

/ (*) da; < B, (85) 
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compare with (J55|) . We want to derive from that data that for some c (T) > 0, 
c (T) — > as T — > oo 



/ (x) > 1 - c (T) for all x > 0. 

Denote by 

a (x)-{ 1 ^t- T '°] 
^ o(x) -\ x$[-T,0] ■ 

Since / > g, we have / (x) > #i (x) = [g * q x ] (x) for x > 0. We define 
<7i (x) = (#) for x < 0. Iterating, we have / (x) > g n (x) , where 



g (x) x < 
[fi-n-i * q x ) {x) x > 



Hence, / (x) > g^ (x) . The function g^ (x) has the following probabilistic 
interpretation: we have a Markov chain on Mr, where transition from the 
point x is governed by transition densities q x to make the step (to the left), 
(and which steps to the left are defined in an arbitrary way for x < 0); then 
the value g^ (x) for x > is the probability that starting from x we will visit 
the interval [— T, 0] . The question now is about the lower bound on g^ (x) 
over all possible q x from our class. 

So let us take x > 0, and let start the Markov chain X n from x, (i.e. 
Xq = x), which goes to the left, and which makes a transition from y to y — t 
with the probability q y (t) dt. We need to know the probability of the event 

F x {there exists n such that X n G [— T, 0]} . 

In other words, we want to know the probability of X. visiting [-T, 0] . We 
would like to show that 



F x {X. visits [-T, 0]} > 7 (f3, B, T) (86) 

with 

7 (p, B, T) -f 1 as T -> oo 

uniformly over the families q x from our class. 

Note, however, that in general such an estimate does not hold. For exam- 
ple, the process X. can well stay positive for all times. The more interesting 
example where the process goes to — oo, follows, so we will need further 
restrictions on the family q x . 
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Example. Let T be given. We will construct the family gj from our 
class (J85|) . such that for the corresponding process X T 

F X {X T visits [0,T]} = 0. 

We define q x (i) for x G (A;, k + 1] with integer k 7^ to be any distribution 
localized in the segment [k — 1, k] (the uniform distribution on [k — 1, k] is 
OK). For x G o*=t]> ^ = 1,2, it is defined by 

(*) = J 2 fe+1 (l - JJ^ e-*dt) if * G [x - ^, a: - 
^ otherwice. 

For x < it is defined in an arbitrary way. ■ 

The mechanism of violating the relation (j8fi|) is that the time the process 
X T can spend in the segment [0, 1] is unbounded in T. As the following 
theorem shows, this feature is the only obstruction for the statement desired 
to hold. 

Theorem 17 Consider the Markov chain X. defined above via the transition 
densities q x (t) . Suppose that condition holds, and that in addition these 
densities are uniformly bounded in the vicinity of the origin: for all real x 
and all t in the segment [0, 1] ; say, 

q x (t) < C. (87) 

Then for some 7 {(3, B, C, T) — > 1 as T — > 00 we have: 

¥ x {X. visits [-T, 0]} > 7 (J3, B, C, T) . 

The condition ()87|) in the case of NMP follows easily from the estimate 
(JoT?|) , see Lemma ITU1 

Proof. We will estimate the probability of the complementary event: 



F X {X. misses [-T,0]} 



E 

fc=0 



q y (t) dt 

Uy+T 



Pk (x, dy) . 



Here Pk (x, dy) is the probability distribution of the chain X. after k steps, 
and the expression J^_ T q y (t) dt Pk (x, dy) is the probability that the chain 
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X. arrives after k steps to the location y, and then makes a jump over the 
segment [— T, 0] . So we have 

Pa. {X misses [-T,0]} 



< 



JO u -n 



[x] + l 



k=0 

00 



n=0 



fc=0 



where (x, [n, n + 1]) is the probability of the event X k G [n, n + 1] , and 
where in the second line we are using the following simple estimate: 

/*oo /*oo poo 

/ <^ (t) dt = j r p q y (t) dt < r" 13 / t p q y (t) dt. 

Jr Jr JO 



Now, 



k=0 



J2^AX k e[n,n + l]} (88) 

00 

Yl F * ( Xk G t n ' n + ^ ' Xl > n + Xi + X e [n, 71 + 1]} 

fc=0 Z<fc 
00 

^F x {X l >n+l,X l+1 G [n,n + l]} 

1=0 

J2 p x' {Xi+k e [n, n + 1] X, > n + 1, X m G [n, n + 1]} . 



k>0 



Let now the random variables Q be i.i.d., uniformly distributed in the segment 
[0, ^] , where C is the same as in ([SB]). Then is easy to see that 

Px{x +fc G [n,n + l] I X, >n+l,X +1 G [n,n+l]} <Pr{Ci + ... + Cfc < 1} 

Since the last probability decays exponentially in k, while 
YmIo i X i > n + 1, Xi +1 G [n, n + 1]} = 1, we conclude that 

00 

G [n,n + l]}<K(C). 

fc=0 

Since the series ^ti _/3 converges for /3 > 1, the proof follows. ■ 
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13 Self-averaging =>* relaxation: noisy case 



In this section we prove the relaxation for the NMP with general initial 
condition, i.e. for the solution of the equation 

A (x) = (1 - (x)) [A * q\,n, x ) {x) + (x) Q x ^ (x) 

see (|5Uj) . We are not able to prove it in the generality of the previous Sections. 
Below we will use all the specific features of the NMP, and in particular we 
will use the comparison between different NMP-s and GMP-s, corresponding 
to various initial states and input rates. The comparison mentioned is based 
on the coupling arguments. 

13.1 Coupling 

Definition 18 Let /ii,/x 2 be two states on Cl. We call the state Hi to be 
higher than fi 2 , Hi fc= Hit if there exists a coupling P [duii, gL> 2 ] between the 
states [ii, fi2, with the property: 

P [{Cl x = 1, 

where 

(Cl x Cl) y = {[(ni, ri) , (n 2 , r 2 )} E Cl x Cl : m > n 2 } . 

Clearly, if hi )p // 2 , then N (hi) > N (/x 2 ) • 

Definition 19 Let /ii,/i 2 be two states on CI. We call the state Hi to be 
taller than /x 2 , Hi ^ H2, if there exists a coupling P [du)i, tio; 2 ] between the 
states /ii,/i 2 , with the property: 

P [(CI x Q)>] = 1, 

where 

(Cl x fi) >> = {[(ni,^) , (n 2 ,r 2 )] E CI x Cl : r x = r 2 ,n 1 > n 2 or lu 2 = 0} . 

Lemma 20 Let Hi (0) , /i 2 (0) be two initial states on Cl at t — 0, and Ai (i) , 
A 2 (t) , t > fre two Poisson densities of the input flows. The service time 
distribution is the same 77 as before. Let Hi (t) be two corresponding GFP-s, 
with Hi (0) = fi (0)- Suppose that Hi (0) ^ /i 2 (0) , and t/iai Ai it) > \ 2 (t) . 
Then Hi (t) )p /i 2 (t) , so in particular 

N(hi (t))>N(H2 (t)). 
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Proof. To see this let us construct the coupling between the processes 
fii (t) . Let us color the customers arriving according to the A2 (t) flow as red. 
We also assign the red color to the customers which were present at time t — 
from the initial state /i 2 (0). Let 7 (t) = \± (t) — \ 2 (t) , and consider 7 (t) 
as the extra input flow of blue customers (with independent service times). 
We also add blue customers at time t — 0, which are needed to complete the 
state H2 (0) up to [X\ (0) . Then the total (color blind) flow coincides with Ai 
flow, while the total (color blind) process coincides with [i\ (t) . 

The service rule for the two-colored process is color blind: all the cus- 
tomers are served in order of their arrival time. We claim now that along 
every coupled trajectory (uoi (t) , uo 2 (t)) we have R (uoi (t)) > R (uo 2 (t)) , where 
R(-) is the number of red customers at the moment t, waiting to be served. 
That evidently will prove our statement. 

Clearly, the number R (uj (t)) is the difference, 

R{u (t))=A(w (t))-S(u (*)), 

where A(ou (t)) is the total number of red customers, having arrived before 
t, while S (uo (i)) is the total number of red customers, who left the sys- 
tem before t. Clearly, A (u± (t)) = A (uo 2 it)) . Let us show that S (uoi (t)) < 
S{u 2 {t)). 

This is easy to see once one visualizes the procedure of resolving the rod 
conflicts, which corresponds to our service rule, for the two-colored rod case. 
Namely, one has first to put all the red rods, and resolve all their conflicts by 
shifting some of them to the right accordingly. The number of thus obtained 
rods to the left of the point t is the number S (u 2 (t)) . Clearly, if one adds 
some blue rods to the red ones, then each red rod would be shifted to the 
right by at least the same amount as without the blue rods. As a result, 
every red rod would either stay where it was, or move to the right, so indeed 
S (wi (t)) < S (u 2 (f)) . ■ 

13.2 Compactness 

Consider a General Flow Process \x (t) with initial state /j, (0) = v at T — 
and the input rate A (t) = c < 1. This is an ergodic process, so the weak limit 

lim fj, VjC (t) = v c 
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exists and does not depend on the initial state v. We would like to show that 
if N (u) < oo, then also 

limN{fi u>c {t)) = N{v c ) (89) 

t^oo 

(see (I14jl ). This turns out to be somewhat delicate problem, because the 
speed of the convergence fi UyC (t) — > v c is only linear in time, and it can 

happen that for every 5 > the moment K u (n (u) 1+S ^J does not exist, which 

property persists in time, and the moments E Ati/c ( t ) (n (uj) 1+5 ^ are infinite for 
every t. 



13.2.1 Compactification 

With every point u = (n, r) G Q, n > 0, there is associated the random vari- 
able 7] — (n — t rj > t\ . Consider now the following queueing problem: 

the customers are arriving at positive Poissonian times with the rate A (t) = c, 
while service times are independent and //-distributed. In addition, at mo- 
ment there is a customer with service time distributed according to i] , 

T 

and n— 1 redistributed customers. Then the expected size of queue at the mo- 
ment t is precisely iV (ns u ,c (*)) • In general, N (/i UjC (t)) = E u (N (fis u ,c (<)))■ 
We want to study the dependence of N (fi U)C (t)) on v. We abbreviate it by 
N(u,t). 



In general, the family rj 



is not weakly compact. In order to prove our 



statement we have to generalize it, including yq 
family. The generalization is as follows. Note t 

2+<5 



, t > 1 into a compact 
rat the random variables 



have the property that E ( rj 



< Ms. Consider now the set M of 



E (C) 2+5 < M 5 . 



all positive random variables with this property: £ G M < 
This set Af already is weakly compact, due to Prokhorov theorem. We denote 

by M C N the closure of the family |r/ , r > o| in Af. We now extend our 

configuration space Q, to consist of pairs u> = (n, £) , £ G Af. The initial state 
will then be a measure v on Q, i.e. on the set of pairs (n, £) , n > 1, plus the 
single point n = 0. We will use the old notation for all the extended objects. 

Unfortunately, the function iV (v, t) is not continuous on A4 (O) , due to 
the fact that Q is (still) not compact, in the n-direction. This obstruction 
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would be removed once one is contented to restrict the function N (z/, t) to 
M (O^) cM(O), where Q, N = {u = (n, () E Q : n < N} . Then it is enough 
to check that iV {y, t) is continuous on Q C M. , where the imbedding 
Q C M. (Vt) is via (n, Q o~( n ,£)- The function we are dealing with is then 
the following: 

Let x > 0, and N ((n,x) ,t) be the expected size of the queue at the 
moment t, if 

• the customers are arriving at positive Poissonian times with the rate 

A (t) EE C, 

• the service times are independent and 77-distributed, 

• at moment there is a customer with non-random service time, which 
equals x, together with n — 1 77-distributed customers, waiting in the 
queue. 

Now, 

N((n,Q,t) = N (<f (n , c) , t)=E(N ((n, C) , t)) . 

Since the function N ((n,x) ,t) , though continuous, has infinite support in 
the ^-variable for n, t fixed, the continuity of N ((n,Q ,t) in ( (in weak 
topology) needs to be checked. However, N ((n,x) ,t) = ct + n for all x > t, 
and that makes the check trivial. 
In general case 

N(u,t)=E v (E c (N((n,(),t))). 

Now, since (N ((n, () , t)) is a continuous function on {1, N} x A/"xIR + , 
the continuity of iV (u, t) on M. (Vt N ) follows from compactness of {1, iV} x 
J\f. 

Therefore we have obtained the following conditional statement: 

Lemma 21 Suppose for some t > the convergence N (u,t) — > £ Zioids /or 
every u E M. (Q) , as t — > 00. T/ien i/ie convergence is uniform on every 

m (n N ) . 
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13.2.2 Convergence 

Lemma 22 For every n, t we have 

\imN^ S(n , T) At))=N(u c ) (90) 

(though, of course, not uniform in n,r). 

Proof. Since ii 5{n>T) ,c{t) -> v c weakly, limsup^^ N \JJ>8 (ntT) ,c (t)J > 
N(u c ). 

To prove the opposite inequality we need to produce a uniform upper 
bound on the family ps, nT) ,c{t) , in order to have its uniform integrability. 
By this we mean the following property: for every x > there exists a value 

such that for all t 

E H5, .,„(*) i N ( w ) 1 n(u,)>n x ) < x > 

\.7l,T) 

where I stands for the indicator. If it were possible to find an e such that 
v c eb(n )T ) + (1 — s) 5o, then we would be done, since we then have that 

N f^e(5(„ T) +(i- £ )<5 ,c (t)) < N {v c ) for all t. However this is not the case, since 
the measure v c has no atoms. Therefore we have to pass to the imbedded 
Markov chain, as it is done in jS], sect. 5.1. 

Consider the service process started in the configuration (n, r) , with the 
customer arrival rate A = c. Let £j be the number of customers in the system 
right after the (random) moment tj, when the i-th customer was served. We 
put £ = n i to — 0. Then 

= max {0, £i-l + 9i}, 

where Q{ is the number of customers which came to the system during the 
i-th service session. Then the random variables 8q, #i, 62, ■■■ are independent, 
with #1, #2,... identically distributed. The Markov chain & is ergodic. It is 
stationary, except for the first step. We denote by 7r its stationary distribu- 
tion, and by 7r^ n ' T - ) the distribution of the variable £1. We claim that it is 
enough for our purposes to study this chain. Indeed, if we define the process 

u{t) = & + 1 for t e (Vijti], 

and p, (t) be its distribution, then we clearly have p (t) )p fj, (t) . 



63 



Let tt 1 , tt 2 be two probability distributions on N = {0, 1, 2, ...} . As above, 
we will say that tt 1 !>= tt 2 if there is a coupling II of it 1 ,tt 2 , supported by 
(N x N) > = {(ni, n 2 )GNxN:iii> n 2 } . If £}, £ 2 are two stationary Markov 
chains, corresponding to two initial distributions tt 1 , tt 2 at the moment i — 1, 
and if tt 1 )p= tt 2 , then also )p £f. 

Let us show now that for some e > we have 



This is almost evident. Indeed, in case t< — 1»— i > t let us consider the random 
number 9J of customers arriving to the server during the initial portion r 
of time of the i-th service session. Then the event {U — £j_i > r,9J > 
happens with positive probability, while conditioning by this event we have 
that the conditional distribution of is higher than ir ( - n ' T \ The relation (J91|) 
then follows, since the stationary measure can be computed by averaging 
over the trajectories. ■ 

From Lemma |^ we then know that the convergence in ()9U|) is uniform 
over {(n, r) : n < N} for every N. 

The next statement will allow us to treat the unbounded component. 

Lemma 23 There exist N Q = N (c) and T = T (c) , such that the following 
holds: 

Let v = 5( W)T ) denote the initial state, concentrated on the configuration 



with n > N customers, with the first one being already served for a time r. 
Then 



for every r > and every t > T. 

Proof. We start with presenting our choice of iVo and T. Namely, we take 
Nq to be any integer bigger than N (u c ) , while T is defined by the property 
that for every r and every t > T 



(The existence of T follows from the uniformity of the convergence iV lfjLs { 
N{v c )mr.) 

We claim now that for any n > Nq, any r and any t > T 



tt )peTT {n ' T] + {l-e) 5 { 



(91) 




(92) 






64 



To see this let us consider the following auxiliary service discipline: we start 
in the state (n, r) , the input rate is A = c, but the server serves the customers 
only if the queue has more than n — No clients; otherwise the server remains 
idle. Let us denote the resulting states of the corresponding process by 

f^S( n T ),C (t) . Evidently N (jLg^ T) ,c (*)) = N ( H-5( NqiT) ,c {t)j -\-tl — Nq. Therefore, 
for any r and any t >T 

N (AW)<c(*)) <n - 

On the other hand, the processes jig, T) , c (■) and fj,g, , c (■) can be coupled in 
such a way that with probability one N (a)) > N (u) at all times, so 



iv(^ (BiT)iC (t)) <N^ S(nT)>c (t)). 



Together, the three last lemmas imply the relation 
Lemma 24 For all initial states v with N (y) < oo 

]imN(fi ViC (t)) = N(u c ). 

t— >oo 

Proof. Let N £ be the smallest integer k, satisfying 

• k > N (see Lemma ESI), 

• N (^) < e, where we denote by ir the measure obtained from v by 
restricting it to the set = {(n, r) : n > k} . 

Likewise, we define the measure by — v — 
Let us write 

/V (t) = J dv (n, t) /i 5(n t) , c (t) . 

Then 

N (n„ jC (t)) = N( [dv l (n, r) N , , c (t) J + N ( [ (n, r) ^, . c (t) 



From compactness we know that 

N[ [ du l (n, r) ^ (t) ) -> jA (fi) AT (z/ c ) as t 



oo. 
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And the relation (|92|) tells us that for t > T (c) 

N^J di/ T (n,r)^ (niT)/! (t)) <iV(^ T ). 

Hence for all t large enough 

(1 - 2e) JV (z/ c ) < iV 0„, c (t)) < N (i/ c ) + e. 

■ 

13.3 End of the proof in noisy case 

Let ii u ,\ v { ) if) be the non-linear Markov process with the initial state having 
finite mean queue, N (v) < oo. We will show that the function A (t) = X u (t) 
goes to a limit as t — > oo. The idea is the following: 

Suppose m = lim inf A (t) < lim sup^^ A (t) = M. As we already 
know, for every T and every e > there exist some values Ki, K 2 such that 

sup A (x) < m + s, (93) 
xelifi.ifi+T] 



while 



inf A (x) > M - e. (94) 

xe[K 2 ,K 2 +T] 



We want to bring this to contradiction, arguing as follows: 

• First of all, we note that the mean queue, N (fJ, v ,\„( ) (0) does n °t 
change in time, staying equal to the initial value N (u) . On the other 
hand 

• We can compare the state ^ v ,x v {-) (Ki + T) with the state (j,^ x t.s(Ki),m+E CO 
Due to (j9~3~)) , the latter is higher, so 

N^^mm+eiT)) >N(v). (95) 

By the same reasoning, 

N(^ Mi K 2) ,M-s(T))<N(v). (96) 
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• We then claim that once T is large enough, the state /i^ v x , ) (Ki),m+e (T) 
is close to the equilibrium z/ m+e , and moreover 



N (^ v , Xui ,m, m+ z (T)) < N (u m+£ ) + e'. (97) 



By the same reasoning, 



N {^ M (K 2 )M-e (T)) > N {v M _ e ) - e 



(98) 



• Since N (vm-e) > N {v m+£ ) once e is small, the relations ([9"5 |) -(|9"8 j) are 
inconsistent once e' and e" are also small enough. 

We need to prove the relations (J9*7j) and (|9~SJ) . It turns out that the re- 
lation (J9~SJ) is much easier. Indeed, to show it, we can compare the state 
fifj, v A ,.)(jr 2 ),M-e (T) with the state /io,M- £ (T) . The latter is evidently lower - 



- and as soon as T is large enough, /i ,M-e (T) is close to vm-e- Since 
Ho,m-e (T) is also lower than u M _ ei 



Since /io,M- e (T) — > vm-e as T — > oo, (|9*9^) implies that N(fi M _ £ (T)) — > 
(z/a/„ £ ) , which proves (jHHI) • 

In the above proof the important step was to replace the state H v ,\ v (-) (-^2) 
with a lower state 0, which is in fact the lowest. Turning to ()97|) , we see that 
this step can not be mimicked there, since there is no highest state! So, to 
proceed, we need some apriori upper bound on the state [i u ,\ v (-) (Ki) ■ 

Lemma 25 Let v be an arbitrary initial state, with N (u) < 00. Then there 
exist c (y) < 1 and T < 00, such that for every t > T 



Proof. The statement of the lemma is equivalent to the fact that M = 
lim sup^oo A (t) < 1. So suppose the opposite, that M > 1. As we then 
know from Lemma El for every T and every e > we can find a segment 



N (/V„,A„(.)(^),iW- e (T)j > N (h 0M -e (T)) 



(99) 



\ v it) <c{v). 
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[K, K + T], such that A„ (t) > 1 - e for all t G [K, K + T] . This, however, 
contradicts to the statement of Lemma EJ ■ 

So without loss of generality we can assume that the initial state v is 
such that iV [y] < oo, while X v (t) < c < 1 for all t > 0. Clearly, the state 
Hv,\ v if) is dominated by \i v ^ (t) . From the previous section we know that 
N (Hu,c (t)) N (^c) as t — > oo. Moreover, for any £ > fixed we know from 
Lemma 1231 that there exist a level iV (c, e) and a time T (c) , such that for all 
t > T (c) in the state /i^g (t) we have: 

nPi{N(co) =n} <e. (100) 

n>N(c,e) 

Again we may assume that T (c) = 0. 

Define now the time duration T = T (N (c, e) ,m + e) as such that for 
every state v on Q, supported by configurations {(n, r) : n < N (c, e)} , and 
every t > T 

it)) <N(u m+e )+e. (101) 

(The existence of T follows from the compactness, as was explained in the 
preceding section.) As we know from Lemma EE there exist a moment 

K = K (t^ , such that sup t£ ^ K K+ fj \ u (t) < m + e. We claim that at the 

moment K + T the state fM u ,\ v {k + is not much higher than u m+e , so in 
particular 

N (jl VtK (K + f )) < N (Vm+e) + 2e. 

Indeed, let us write 



/Va„ (K) 

K) +/v A „ (K) 

{(n,T):n>N(c,e)} 



{(n,r):n<Af(c,e)} 



Then 



where A (t) = \ u (K + 1) . Then for the first summand the relation (jlOlj) 
holds, since the state K\ relaxes after time T under "higher dynamics" with 

the rate m+e ^> A j , so is very close to >c\ (fl) z/ m+e . For the second summand 
the relation (jlOOj) holds, since A it) < c. That proves the relation (J97)) . 
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